Jun 02 00:24:48 devstack cinder-volume[75507]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75507) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 00:24:48 devstack cinder-volume[75507]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75507) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 00:24:48 devstack cinder-volume[75507]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75507) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 00:24:48 devstack cinder-volume[75507]: INFO dbcounter [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Registered counter for database cinder Jun 02 00:24:48 devstack cinder-volume[75507]: DEBUG oslo_db.sqlalchemy.engines [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75507) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG dbcounter [-] [75507] Writer thread running {{(pid=75507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 00:24:49 devstack cinder-volume[75507]: INFO cinder.rpc [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 02 00:24:49 devstack cinder-volume[75507]: INFO cinder.rpc [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG oslo_db.sqlalchemy.engines [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75507) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 00:24:49 devstack cinder-volume[75507]: INFO cinder.volume.manager [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Determined volume DB was empty at startup. Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG cinder.volume.manager [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75507) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 02 00:24:49 devstack cinder-volume[75507]: INFO cinder.volume.manager [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 02 00:24:49 devstack cinder-volume[75507]: WARNING stevedore.named [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 02 00:24:49 devstack cinder-volume[75507]: WARNING castellan.key_manager [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 00:24:49 devstack cinder-volume[75507]: WARNING cinder.keymgr.conf_key_mgr [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG cinder.volume.drivers.lvm [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75507) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG oslo_concurrency.processutils [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG oslo_concurrency.processutils [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] CMD "cinder-rtstool verify" returned: 0 in 0.405s {{(pid=75507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG oslo_db.sqlalchemy.engines [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75507) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 00:24:49 devstack cinder-volume[75507]: INFO cinder.rpc [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 02 00:24:49 devstack cinder-volume[75507]: INFO cinder.rpc [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 02 00:24:49 devstack cinder-volume[75507]: WARNING stevedore.named [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 02 00:24:49 devstack cinder-volume[75507]: WARNING castellan.key_manager [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 00:24:49 devstack cinder-volume[75507]: INFO cinder.volume.manager [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG oslo_db.sqlalchemy.engines [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75507) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 00:24:49 devstack cinder-volume[75507]: INFO oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Starting 1 workers Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Started child 75672 {{(pid=75507) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Full set of CONF: {{(pid=75507) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] ******************************************************************************** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Configuration options gathered from: {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 02 00:24:49 devstack cinder-volume[75672]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] ================================================================================ {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] allow_availability_zone_fallback = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] allow_compression_on_image_upload = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] allowed_direct_url_schemes = [] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:49 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] api_rate_limit = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] auth_strategy = keystone {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] az_cache_duration = 3600 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_availability_zone = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_host = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_name = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_stats_polling_interval = 60 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backup_api_class = cinder.backup.api.API {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backup_name_template = backup-%s {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backup_use_same_host = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backup_use_temp_snapshot = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] chap_password = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] chap_username = {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cinder_internal_tenant_project_id = 165f7838b0954c3f973eb38a00360bba {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cinder_internal_tenant_user_id = 177e22fedc1248bcaa4a16fdd1e27e99 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cloned_volume_same_az = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cluster = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] compression_format = gzip {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] compute_api_class = cinder.compute.nova.API {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] config_dir = [] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] config_source = [] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] control_exchange = openstack {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] debug = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] default_availability_zone = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] default_group_type = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] default_volume_type = lvmdriver-1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] disk_geometry = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] driver_client_cert = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] driver_client_cert_key = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] driver_data_namespace = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] driver_ssl_cert_path = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] driver_ssl_cert_verify = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] driver_use_ssl = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] enable_force_upload = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] enable_new_services = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] enable_unsupported_driver = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] enforce_multipath_for_image_xfer = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] filter_function = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance_api_insecure = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance_api_servers = ['http://192.168.122.144/image'] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance_api_ssl_compression = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance_ca_certificates_file = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance_catalog_info = image:glance:publicURL {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance_certfile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance_keyfile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance_num_retries = 3 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance_request_timeout = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] goodness_function = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] graceful_shutdown_timeout = 5 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] group_api_class = cinder.group.api.API {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] host = devstack {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] image_compress_on_upload = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] image_conversion_address_space_limit = 1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] image_conversion_cpu_limit = 60 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] image_conversion_disable = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] image_upload_use_cinder_backend = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] image_upload_use_internal_tenant = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] image_volume_cache_enabled = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] image_volume_cache_max_count = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] image_volume_cache_max_size_gb = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] init_host_max_objects_retrieval = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] instance_format = [instance: %(uuid)s] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] iscsi_target_flags = {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] iscsi_write_cache = on {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] iser_helper = tgtadm {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] iser_ip_address = 192.168.122.144 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] iser_port = 3260 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] log_color = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] log_config_append = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] log_dir = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] log_file = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] log_options = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] log_rotate_interval = 1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75672]: INFO cinder.volume.manager [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] log_rotate_interval_type = days {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] log_rotation_type = none {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] max_age = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] max_logfile_count = 30 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] max_logfile_size_mb = 200 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] max_over_subscription_ratio = 20.0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] message_reap_interval = 86400 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] message_ttl = 2592000 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] migration_create_volume_timeout_secs = 300 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] monkey_patch = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] monkey_patch_modules = [] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] my_ip = 192.168.122.144 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] no_snapshot_gb_quota = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] num_iser_scan_tries = 3 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] num_shell_tries = 3 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] num_volume_device_scan_tries = 3 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] nvmeof_conn_info_version = 1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack sudo[75676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] nvmet_ns_id = 10 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] nvmet_port_id = 1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] osapi_max_limit = 1000 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] osapi_volume_ext_list = [] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] osapi_volume_listen_port = 8776 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack sudo[75676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] osapi_volume_use_ssl = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] osapi_volume_workers = 2 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] per_volume_size_limit = -1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] periodic_fuzzy_delay = 60 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] periodic_interval = 60 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] public_endpoint = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] publish_errors = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] quota_backup_gigabytes = 1000 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] quota_backups = 10 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] quota_gigabytes = 1000 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] quota_groups = 10 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] quota_snapshots = 10 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] quota_volumes = 10 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] rate_limit_burst = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] rate_limit_except_level = CRITICAL {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] rate_limit_interval = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] reinit_driver_count = 3 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] replication_device = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] report_discard_supported = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] report_interval = 120 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] reservation_clean_interval = 86400 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] reservation_expire = 86400 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] reserved_image_namespaces = [] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] reserved_percentage = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] rpc_response_timeout = 120 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] run_external_periodic_tasks = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] scst_target_driver = iscsi {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] scst_target_iqn_name = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] service_down_time = 720 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] shell_completion = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] snapshot_name_template = snapshot-%s {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] snapshot_same_host = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] split_loggers = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] state_path = /opt/stack/data/cinder {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] storage_availability_zone = nova {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] storage_protocol = iSCSI {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] syslog_log_facility = LOG_USER {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] target_helper = lioadm {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] target_ip_address = 192.168.122.144 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] target_port = 3260 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] target_protocol = iscsi {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] target_secondary_ip_addresses = [] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] trace_flags = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] transport_url = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] until_refresh = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] use_chap_auth = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] use_default_quota_class = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] use_journal = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] use_json = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] use_multipath_for_image_xfer = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] use_stderr = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] use_syslog = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] verify_glance_signatures = enabled {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] volume_api_class = cinder.volume.api.API {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] volume_backend_name = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] volume_clear = zero {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] volume_clear_ionice = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] volume_clear_size = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] volume_copy_bps_limit = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] volume_dd_blocksize = 1M {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] volume_name_template = volume-%s {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] volume_service_inithost_offload = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] volume_usage_audit_period = month {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] zoning_mode = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_concurrency.disable_process_locking = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.075s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.admin_password = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.admin_token = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.admin_user = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.auth_port = 35357 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.auth_protocol = https {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.auth_section = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.auth_type = password {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.auth_uri = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.auth_version = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.cache = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.certfile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.identity_uri = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.include_service_catalog = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.insecure = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.interface = public {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.keyfile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.memcache_password = {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.memcache_username = {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.region_name = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.service_type = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.144/identity {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.backend = dogpile.cache.null {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.backend_argument = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.backend_expiration_time = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.config_prefix = cache.oslo {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.debug_cache_backend = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.enable_retry_client = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.enable_socket_keepalive = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.enabled = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.enforce_fips_mode = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.expiration_time = 600 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.hashclient_retry_attempts = 2 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.memcache_dead_retry = 300 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.memcache_pool_maxsize = 10 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.memcache_sasl_enabled = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.password = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:50 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.proxies = [] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.redis_db = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.redis_server = localhost:6379 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.retry_attempts = 2 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.retry_delay = 0.0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.socket_keepalive_count = 1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.socket_keepalive_idle = 1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.socket_keepalive_interval = 1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.socket_timeout = 1.0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.tls_allowed_ciphers = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.tls_cafile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.tls_certfile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.tls_enabled = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.tls_keyfile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cache.username = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] coordination.backend_url = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.asyncio_connection = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.asyncio_slave_connection = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.backend = sqlalchemy {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.connection = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.connection_debug = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.connection_parameters = {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.connection_recycle_time = 3600 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.connection_trace = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.db_inc_retry_interval = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.db_max_retries = 20 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.db_max_retry_interval = 10 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.db_retry_interval = 1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.max_overflow = 50 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.max_pool_size = 5 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.max_retries = 10 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.mysql_wsrep_sync_wait = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.pool_timeout = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.retry_interval = 10 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.slave_connection = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.sqlite_synchronous = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.synchronous_reader = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] database.use_db_reconnect = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] profiler.connection_string = messaging:// {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] profiler.enabled = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] profiler.es_doc_type = notification {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] profiler.es_scroll_size = 10000 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] profiler.es_scroll_time = 2m {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] profiler.filter_error_trace = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] profiler.hmac_keys = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] profiler.sentinel_service_name = mymaster {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] profiler.socket_timeout = 0.1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] profiler.trace_requests = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] profiler.trace_sqlalchemy = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] profiler_jaeger.process_tags = {} {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] profiler_jaeger.service_name_prefix = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] profiler_otlp.service_name_prefix = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_policy.enforce_new_defaults = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:50 devstack cinder-volume[75507]: WARNING oslo_config.cfg [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_policy.enforce_scope = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_policy.policy_default_rule = default {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_policy.policy_file = policy.yaml {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] privsep_osbrick.group = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] privsep_osbrick.helper_command = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] privsep_osbrick.user = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cinder_sys_admin.group = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cinder_sys_admin.helper_command = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] cinder_sys_admin.user = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] service_user.auth_section = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] service_user.auth_type = password {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] service_user.cafile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] service_user.certfile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] service_user.collect_timing = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] service_user.insecure = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] service_user.keyfile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] service_user.send_service_user_token = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] service_user.split_loggers = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] service_user.timeout = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance.auth_section = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance.auth_type = password {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance.certfile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance.collect_timing = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance.insecure = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance.keyfile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance.region_name = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance.split_loggers = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] glance.timeout = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.backend_availability_zone = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.chap_password = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.chap_username = {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.disk_geometry = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.driver_client_cert = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.driver_client_cert_key = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.driver_data_namespace = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.driver_use_ssl = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.extra_capabilities = {} {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.filter_function = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.goodness_function = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.iscsi_target_flags = {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.iscsi_write_cache = on {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.iser_helper = tgtadm {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.iser_ip_address = 192.168.122.144 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.iser_port = 3260 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.lvm_share_target = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.lvm_type = auto {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.num_shell_tries = 3 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.replication_device = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.report_discard_supported = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.reserved_percentage = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.target_helper = tgtadm {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.target_ip_address = 192.168.122.144 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.target_port = 3260 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.target_protocol = iscsi {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.trace_flags = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.unique_fqdn_network = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.use_chap_auth = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.volume_backend_name = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.volume_clear = zero {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.volume_clear_ionice = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.volume_clear_size = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_reports.file_event_handler = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_reports.log_dir = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.backend_host = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.chap_password = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.chap_username = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.disk_geometry = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.driver_client_cert = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.extra_capabilities = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.filter_function = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.goodness_function = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.iser_helper = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.iser_ip_address = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.iser_port = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.lvm_share_target = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.lvm_type = auto {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.num_shell_tries = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.replication_device = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.report_discard_supported = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.reserved_percentage = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.scst_target_driver = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.storage_protocol = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.target_helper = lioadm {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.target_ip_address = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.target_port = 3260 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.trace_flags = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.use_chap_auth = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.volume_clear = zero {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.volume_clear_size = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] lvmdriver-1.volumes_dir = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.ssl = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_notifications.driver = [] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_notifications.retry = -1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] key_manager.fixed_key = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican.barbican_api_version = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican.barbican_endpoint = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican.barbican_endpoint_type = public {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican.barbican_region_name = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican.cafile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican.certfile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican.collect_timing = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican.insecure = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican.keyfile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican.number_of_retries = 60 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican.retry_delay = 1 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican.send_service_user_token = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican.split_loggers = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican.timeout = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican.verify_ssl = True {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican.verify_ssl_path = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican_service_user.auth_section = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican_service_user.auth_type = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican_service_user.cafile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican_service_user.certfile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican_service_user.collect_timing = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican_service_user.insecure = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican_service_user.keyfile = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican_service_user.split_loggers = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] barbican_service_user.timeout = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] vault.approle_role_id = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] vault.approle_secret_id = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] vault.kv_mountpoint = secret {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] vault.kv_path = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] vault.kv_version = 2 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] vault.namespace = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] vault.root_token_id = **** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] vault.ssl_ca_crt_file = None {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] vault.timeout = 60.0 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] vault.use_ssl = False {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:24:50 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] ******************************************************************************** {{(pid=75507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 02 00:24:50 devstack sudo[75676]: pam_unix(sudo:session): session closed for user root Jun 02 00:24:50 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.749s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:50 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:50 devstack sudo[75768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 00:24:50 devstack sudo[75768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:24:51 devstack sudo[75768]: pam_unix(sudo:session): session closed for user root Jun 02 00:24:51 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.629s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:51 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:24:51 devstack cinder-volume[75672]: INFO cinder.brick.local_dev.lvm [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 02 00:24:51 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:51 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:51 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:51 devstack sudo[75985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 00:24:51 devstack sudo[75985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:24:52 devstack sudo[75985]: pam_unix(sudo:session): session closed for user root Jun 02 00:24:52 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:52 devstack cinder-volume[75672]: DEBUG cinder.brick.local_dev.lvm [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75672) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 02 00:24:52 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:52 devstack sudo[76162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 00:24:52 devstack sudo[76162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:24:53 devstack sudo[76162]: pam_unix(sudo:session): session closed for user root Jun 02 00:24:53 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.502s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:53 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:53 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:53 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:53 devstack sudo[76424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 00:24:53 devstack sudo[76424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:24:54 devstack sudo[76424]: pam_unix(sudo:session): session closed for user root Jun 02 00:24:54 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.755s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:54 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:54 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:54 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:54 devstack sudo[76453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 02 00:24:54 devstack sudo[76453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:24:55 devstack sudo[76453]: pam_unix(sudo:session): session closed for user root Jun 02 00:24:55 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.613s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:55 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:55 devstack sudo[76456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 00:24:55 devstack sudo[76456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:24:55 devstack sudo[76456]: pam_unix(sudo:session): session closed for user root Jun 02 00:24:55 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:55 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:55 devstack sudo[76461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 00:24:55 devstack sudo[76461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:24:56 devstack sudo[76461]: pam_unix(sudo:session): session closed for user root Jun 02 00:24:56 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:56 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:56 devstack sudo[76464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 00:24:56 devstack sudo[76464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:24:56 devstack sudo[76464]: pam_unix(sudo:session): session closed for user root Jun 02 00:24:56 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:56 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:56 devstack sudo[76469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 00:24:56 devstack sudo[76469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:24:57 devstack sudo[76469]: pam_unix(sudo:session): session closed for user root Jun 02 00:24:57 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.809s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:57 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:57 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:57 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:57 devstack sudo[76477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 00:24:57 devstack sudo[76477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:24:58 devstack sudo[76477]: pam_unix(sudo:session): session closed for user root Jun 02 00:24:58 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.633s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:58 devstack cinder-volume[75672]: INFO cinder.volume.drivers.lvm [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 02 00:24:58 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:58 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:58 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:58 devstack sudo[76481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 00:24:58 devstack sudo[76481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:24:59 devstack sudo[76481]: pam_unix(sudo:session): session closed for user root Jun 02 00:24:59 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.904s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:24:59 devstack cinder-volume[75672]: DEBUG cinder.volume.drivers.lvm [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Updating volume stats {{(pid=75672) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 00:24:59 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:24:59 devstack sudo[76600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 00:24:59 devstack sudo[76600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:24:59 devstack cinder-volume[75507]: DEBUG dbcounter [-] [75507] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:25:00 devstack sudo[76600]: pam_unix(sudo:session): session closed for user root Jun 02 00:25:00 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:25:00 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:25:00 devstack sudo[76605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 00:25:00 devstack sudo[76605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:25:00 devstack sudo[76605]: pam_unix(sudo:session): session closed for user root Jun 02 00:25:00 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:25:00 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:25:00 devstack sudo[76746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 00:25:00 devstack sudo[76746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:25:01 devstack sudo[76746]: pam_unix(sudo:session): session closed for user root Jun 02 00:25:01 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.606s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:25:01 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:25:01 devstack sudo[76752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 00:25:01 devstack sudo[76752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:25:01 devstack sudo[76752]: pam_unix(sudo:session): session closed for user root Jun 02 00:25:01 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:25:01 devstack cinder-volume[75672]: INFO cinder.volume.driver [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Driver hasn't implemented _init_vendor_properties() Jun 02 00:25:01 devstack cinder-volume[75672]: DEBUG cinder.volume.driver [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75672) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 02 00:25:01 devstack cinder-volume[75672]: DEBUG oslo_db.sqlalchemy.engines [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75672) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 00:25:01 devstack cinder-volume[75672]: DEBUG dbcounter [-] [75672] Writer thread running {{(pid=75672) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 00:25:01 devstack cinder-volume[75672]: DEBUG cinder.db.sqlalchemy.api [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Building query based on filter {{(pid=75672) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 02 00:25:01 devstack cinder-volume[75672]: DEBUG cinder.image.image_utils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75672) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 02 00:25:01 devstack cinder-volume[75672]: INFO cinder.keymgr.migration [None req-51e7b4b7-f1ca-4855-854c-a54d5f491f81 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 02 00:25:01 devstack cinder-volume[75672]: DEBUG cinder.volume.drivers.lvm [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Updating volume stats {{(pid=75672) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 00:25:01 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:25:01 devstack sudo[76759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 00:25:01 devstack sudo[76759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:25:02 devstack sudo[76759]: pam_unix(sudo:session): session closed for user root Jun 02 00:25:02 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:25:02 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:25:02 devstack sudo[76762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 00:25:02 devstack sudo[76762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:25:03 devstack sudo[76762]: pam_unix(sudo:session): session closed for user root Jun 02 00:25:03 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:25:03 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:25:03 devstack sudo[76766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 00:25:03 devstack sudo[76766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:25:03 devstack sudo[76766]: pam_unix(sudo:session): session closed for user root Jun 02 00:25:03 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.624s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:25:03 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:25:03 devstack sudo[76770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 00:25:03 devstack sudo[76770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:25:04 devstack sudo[76770]: pam_unix(sudo:session): session closed for user root Jun 02 00:25:04 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:25:04 devstack cinder-volume[75672]: DEBUG cinder.manager [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Notifying Schedulers of capabilities ... {{(pid=75672) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:25:04 devstack cinder-volume[75672]: INFO cinder.volume.manager [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Driver initialization completed successfully. Jun 02 00:25:04 devstack cinder-volume[75672]: INFO cinder.manager [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Initiating service 2 cleanup Jun 02 00:25:04 devstack cinder-volume[75672]: INFO cinder.manager [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Service 2 cleanup completed. Jun 02 00:25:04 devstack cinder-volume[75672]: DEBUG cinder.service [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Creating RPC server for service cinder-volume {{(pid=75672) start /opt/stack/cinder/cinder/service.py:231}} Jun 02 00:25:04 devstack cinder-volume[75672]: DEBUG cinder.service [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75672) start /opt/stack/cinder/cinder/service.py:237}} Jun 02 00:25:04 devstack cinder-volume[75672]: INFO cinder.volume.manager [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 02 00:25:04 devstack cinder-volume[75672]: DEBUG cinder.volume.drivers.lvm [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Updating volume stats {{(pid=75672) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 00:25:04 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:25:04 devstack sudo[76777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 00:25:04 devstack sudo[76777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:25:05 devstack sudo[76777]: pam_unix(sudo:session): session closed for user root Jun 02 00:25:05 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:25:05 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:25:05 devstack sudo[76780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 00:25:05 devstack sudo[76780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:25:05 devstack sudo[76780]: pam_unix(sudo:session): session closed for user root Jun 02 00:25:05 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:25:05 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:25:05 devstack sudo[76784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 00:25:05 devstack sudo[76784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:25:06 devstack sudo[76784]: pam_unix(sudo:session): session closed for user root Jun 02 00:25:06 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.616s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:25:06 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:25:06 devstack sudo[76787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 00:25:06 devstack sudo[76787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:25:07 devstack sudo[76787]: pam_unix(sudo:session): session closed for user root Jun 02 00:25:07 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:25:07 devstack cinder-volume[75672]: INFO cinder.volume.manager [None req-8b0b618b-7bff-453c-b065-7d3abb3fea6d None None] Driver post RPC initialization completed successfully. Jun 02 00:25:17 devstack cinder-volume[75672]: DEBUG dbcounter [-] [75672] Writing DB stats cinder:SELECT=4 {{(pid=75672) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:25:17 devstack cinder-volume[75672]: DEBUG dbcounter [-] [75672] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75672) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:26:48 devstack cinder-volume[75672]: DEBUG oslo_service.periodic_task [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:26:48 devstack cinder-volume[75672]: DEBUG cinder.volume.drivers.lvm [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Updating volume stats {{(pid=75672) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 00:26:48 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:26:48 devstack sudo[82266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 00:26:48 devstack sudo[82266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:26:48 devstack sudo[82266]: pam_unix(sudo:session): session closed for user root Jun 02 00:26:48 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:26:48 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:26:48 devstack sudo[82284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 00:26:48 devstack sudo[82284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:26:49 devstack sudo[82284]: pam_unix(sudo:session): session closed for user root Jun 02 00:26:49 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:26:49 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:26:49 devstack sudo[82287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 00:26:49 devstack sudo[82287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:26:50 devstack sudo[82287]: pam_unix(sudo:session): session closed for user root Jun 02 00:26:50 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.592s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:26:50 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:26:50 devstack sudo[82295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 00:26:50 devstack sudo[82295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:26:50 devstack sudo[82295]: pam_unix(sudo:session): session closed for user root Jun 02 00:26:50 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:26:50 devstack cinder-volume[75672]: DEBUG cinder.manager [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Notifying Schedulers of capabilities ... {{(pid=75672) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:27:17 devstack cinder-volume[75672]: DEBUG dbcounter [-] [75672] Writing DB stats cinder:SELECT=1 {{(pid=75672) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:27:17 devstack cinder-volume[75672]: DEBUG dbcounter [-] [75672] Writing DB stats cinder:UPDATE=1 {{(pid=75672) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:27:48 devstack cinder-volume[75672]: DEBUG oslo_service.periodic_task [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:27:48 devstack cinder-volume[75672]: DEBUG cinder.volume.drivers.lvm [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Updating volume stats {{(pid=75672) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 00:27:48 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:27:48 devstack sudo[83678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 00:27:48 devstack sudo[83678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:27:48 devstack sudo[83678]: pam_unix(sudo:session): session closed for user root Jun 02 00:27:48 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:27:48 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:27:48 devstack sudo[83702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 00:27:48 devstack sudo[83702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:27:49 devstack sudo[83702]: pam_unix(sudo:session): session closed for user root Jun 02 00:27:49 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:27:49 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:27:49 devstack sudo[83733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 00:27:49 devstack sudo[83733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:27:49 devstack sudo[83733]: pam_unix(sudo:session): session closed for user root Jun 02 00:27:49 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.587s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:27:49 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:27:49 devstack sudo[83772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 00:27:49 devstack sudo[83772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:27:50 devstack sudo[83772]: pam_unix(sudo:session): session closed for user root Jun 02 00:27:50 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.588s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:27:50 devstack cinder-volume[75672]: DEBUG cinder.manager [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Notifying Schedulers of capabilities ... {{(pid=75672) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:28:48 devstack cinder-volume[75672]: DEBUG oslo_service.periodic_task [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75672) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:28:48 devstack cinder-volume[75672]: DEBUG cinder.volume.drivers.lvm [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Updating volume stats {{(pid=75672) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 00:28:48 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:28:48 devstack sudo[85052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 00:28:48 devstack sudo[85052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:28:48 devstack sudo[85052]: pam_unix(sudo:session): session closed for user root Jun 02 00:28:48 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:28:48 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:28:48 devstack sudo[85072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 00:28:48 devstack sudo[85072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:28:49 devstack sudo[85072]: pam_unix(sudo:session): session closed for user root Jun 02 00:28:49 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:28:49 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:28:49 devstack sudo[85095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 00:28:49 devstack sudo[85095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:28:50 devstack sudo[85095]: pam_unix(sudo:session): session closed for user root Jun 02 00:28:50 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.617s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:28:50 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:28:50 devstack sudo[85106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 00:28:50 devstack sudo[85106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:28:50 devstack sudo[85106]: pam_unix(sudo:session): session closed for user root Jun 02 00:28:50 devstack cinder-volume[75672]: DEBUG oslo_concurrency.processutils [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=75672) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:28:50 devstack cinder-volume[75672]: DEBUG cinder.manager [None req-bd785076-5e25-4cfd-ae1f-8ec43647c89a None None] Notifying Schedulers of capabilities ... {{(pid=75672) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:29:17 devstack cinder-volume[75672]: DEBUG dbcounter [-] [75672] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75672) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:29:31 devstack cinder-volume[75507]: INFO oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Caught SIGTERM, stopping children Jun 02 00:29:31 devstack cinder-volume[75507]: DEBUG oslo_concurrency.lockutils [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Acquiring lock "singleton_lock" {{(pid=75507) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 00:29:31 devstack cinder-volume[75507]: DEBUG oslo_concurrency.lockutils [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Acquired lock "singleton_lock" {{(pid=75507) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 00:29:31 devstack cinder-volume[75507]: DEBUG oslo_concurrency.lockutils [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Releasing lock "singleton_lock" {{(pid=75507) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 00:29:31 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Stop services. {{(pid=75507) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 02 00:29:31 devstack cinder-volume[75507]: DEBUG oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Killing children. {{(pid=75507) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 02 00:29:31 devstack cinder-volume[75507]: INFO oslo_service.backend._eventlet.service [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Waiting on 1 children to exit Jun 02 00:29:36 devstack cinder-volume[75672]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 02 00:29:39 devstack cinder-volume[86053]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86053) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 00:29:39 devstack cinder-volume[86053]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86053) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 00:29:39 devstack cinder-volume[86053]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86053) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 00:29:39 devstack cinder-volume[75672]: DEBUG oslo_concurrency.lockutils [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Acquiring lock "singleton_lock" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 00:29:39 devstack cinder-volume[75672]: DEBUG oslo_concurrency.lockutils [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Acquired lock "singleton_lock" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 00:29:39 devstack cinder-volume[75672]: DEBUG oslo_concurrency.lockutils [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Releasing lock "singleton_lock" {{(pid=75672) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 00:29:39 devstack cinder-volume[75672]: WARNING amqp [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 02 00:29:39 devstack cinder-volume[75672]: WARNING amqp [None req-a09d0212-ba82-404e-98c5-fa93c3c01640 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 02 00:29:40 devstack cinder-volume[86053]: INFO dbcounter [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Registered counter for database cinder Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_db.sqlalchemy.engines [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86053) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG dbcounter [-] [86053] Writer thread running {{(pid=86053) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 00:29:40 devstack cinder-volume[86053]: INFO cinder.rpc [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 02 00:29:40 devstack cinder-volume[86053]: INFO cinder.rpc [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_db.sqlalchemy.engines [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86053) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 00:29:40 devstack cinder-volume[86053]: INFO cinder.volume.manager [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Determined volume DB was empty at startup. Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG cinder.volume.manager [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86053) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 02 00:29:40 devstack cinder-volume[86053]: INFO cinder.volume.manager [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 02 00:29:40 devstack cinder-volume[86053]: WARNING stevedore.named [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 02 00:29:40 devstack cinder-volume[86053]: WARNING castellan.key_manager [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 00:29:40 devstack cinder-volume[86053]: WARNING cinder.keymgr.conf_key_mgr [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 00:29:40 devstack cinder-volume[86053]: INFO cinder.volume.manager [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_db.sqlalchemy.engines [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86053) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 00:29:40 devstack cinder-volume[86053]: INFO oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Starting 1 workers Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Started child 86325 {{(pid=86053) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Full set of CONF: {{(pid=86053) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] ******************************************************************************** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Configuration options gathered from: {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] ================================================================================ {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] allow_availability_zone_fallback = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] allow_compression_on_image_upload = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] allowed_direct_url_schemes = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] api_rate_limit = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] auth_strategy = keystone {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_availability_zone = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_host = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_stats_polling_interval = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backup_api_class = cinder.backup.api.API {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backup_name_template = backup-%s {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backup_use_same_host = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backup_use_temp_snapshot = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] chap_password = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] chap_username = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cinder_internal_tenant_project_id = 165f7838b0954c3f973eb38a00360bba {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cinder_internal_tenant_user_id = 177e22fedc1248bcaa4a16fdd1e27e99 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86325]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cluster = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] compression_format = gzip {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] compute_api_class = cinder.compute.nova.API {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] config_dir = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] config_source = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] control_exchange = openstack {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] debug = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] default_availability_zone = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] default_group_type = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] default_volume_type = QuobyteHD {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] disk_geometry = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] driver_client_cert = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] driver_client_cert_key = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] driver_data_namespace = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] driver_ssl_cert_path = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] driver_ssl_cert_verify = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] driver_use_ssl = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] enable_new_services = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] enable_unsupported_driver = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] enabled_backends = ['QuobyteHD'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] enforce_multipath_for_image_xfer = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] filter_function = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance_api_insecure = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance_api_servers = ['http://192.168.122.144/image'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance_api_ssl_compression = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance_ca_certificates_file = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance_catalog_info = image:glance:publicURL {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance_certfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance_keyfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance_num_retries = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance_request_timeout = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] goodness_function = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] graceful_shutdown_timeout = 5 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] group_api_class = cinder.group.api.API {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] host = devstack {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] image_compress_on_upload = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] image_conversion_address_space_limit = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] image_conversion_cpu_limit = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] image_conversion_disable = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] image_upload_use_cinder_backend = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] image_upload_use_internal_tenant = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] image_volume_cache_enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] image_volume_cache_max_count = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] image_volume_cache_max_size_gb = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] init_host_max_objects_retrieval = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] instance_format = [instance: %(uuid)s] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] iscsi_target_flags = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] iscsi_write_cache = on {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] iser_helper = tgtadm {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] iser_ip_address = 192.168.122.144 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] iser_port = 3260 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] log_color = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] log_config_append = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] log_dir = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] log_file = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] log_options = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] log_rotate_interval = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] log_rotate_interval_type = days {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] log_rotation_type = none {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] max_age = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] max_logfile_count = 30 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] max_logfile_size_mb = 200 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] max_over_subscription_ratio = 20.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] message_reap_interval = 86400 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] message_ttl = 2592000 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] migration_create_volume_timeout_secs = 300 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] monkey_patch = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] monkey_patch_modules = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] my_ip = 192.168.122.144 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] no_snapshot_gb_quota = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] num_iser_scan_tries = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] num_shell_tries = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] num_volume_device_scan_tries = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] nvmeof_conn_info_version = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] nvmet_ns_id = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] nvmet_port_id = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] osapi_max_limit = 1000 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] osapi_volume_ext_list = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] osapi_volume_listen_port = 8776 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] osapi_volume_use_ssl = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] osapi_volume_workers = 2 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] per_volume_size_limit = -1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] periodic_fuzzy_delay = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] periodic_interval = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] public_endpoint = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] publish_errors = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] quota_backup_gigabytes = 1000 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] quota_backups = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] quota_gigabytes = 1000 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] quota_groups = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] quota_snapshots = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] quota_volumes = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] rate_limit_burst = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] rate_limit_except_level = CRITICAL {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] rate_limit_interval = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] reinit_driver_count = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] replication_device = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] report_discard_supported = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] report_interval = 120 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] reservation_clean_interval = 86400 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] reservation_expire = 86400 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] reserved_image_namespaces = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] reserved_percentage = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] rpc_response_timeout = 120 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] run_external_periodic_tasks = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] scst_target_driver = iscsi {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] scst_target_iqn_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] service_down_time = 720 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] shell_completion = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] snapshot_name_template = snapshot-%s {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] split_loggers = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] state_path = /opt/stack/data/cinder {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] storage_availability_zone = nova {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] storage_protocol = iSCSI {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] syslog_log_facility = LOG_USER {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] target_helper = lioadm {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] target_ip_address = 192.168.122.144 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] target_port = 3260 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] target_protocol = iscsi {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] target_secondary_ip_addresses = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86325]: INFO cinder.volume.manager [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] trace_flags = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.remotefs [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86325) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] transport_url = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] until_refresh = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] use_chap_auth = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] use_default_quota_class = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] use_journal = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] use_json = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] use_multipath_for_image_xfer = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] use_stderr = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] use_syslog = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] verify_glance_signatures = enabled {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] volume_api_class = cinder.volume.api.API {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] volume_backend_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] volume_clear = zero {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] volume_clear_ionice = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] volume_clear_size = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] volume_copy_bps_limit = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] volume_dd_blocksize = 1M {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] volume_name_template = volume-%s {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] volume_service_inithost_offload = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] volume_usage_audit_period = month {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] zoning_mode = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_concurrency.disable_process_locking = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.admin_password = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.admin_token = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.admin_user = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.auth_admin_prefix = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.auth_port = 35357 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.auth_protocol = https {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.auth_section = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.auth_type = password {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.auth_uri = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.auth_version = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.cache = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.certfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.identity_uri = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.include_service_catalog = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.insecure = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.interface = public {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.keyfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.memcache_password = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.memcache_username = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.region_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.service_token_roles_required = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.service_type = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.144/identity {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.backend = dogpile.cache.null {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.backend_argument = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.backend_expiration_time = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.config_prefix = cache.oslo {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.debug_cache_backend = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.enable_retry_client = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.enable_socket_keepalive = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.enforce_fips_mode = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.expiration_time = 600 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.hashclient_retry_attempts = 2 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.memcache_dead_retry = 300 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.memcache_pool_maxsize = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.memcache_sasl_enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.password = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.proxies = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.redis_db = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.redis_server = localhost:6379 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.retry_attempts = 2 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.retry_delay = 0.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.socket_keepalive_count = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.socket_keepalive_idle = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.socket_keepalive_interval = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.socket_timeout = 1.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.tls_allowed_ciphers = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.tls_cafile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.tls_certfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.tls_enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.tls_keyfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cache.username = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] coordination.backend_url = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.asyncio_connection = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.asyncio_slave_connection = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.backend = sqlalchemy {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.connection = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.connection_debug = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.connection_parameters = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.connection_recycle_time = 3600 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.connection_trace = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.db_inc_retry_interval = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.db_max_retries = 20 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.db_max_retry_interval = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.db_retry_interval = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.max_overflow = 50 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.max_pool_size = 5 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.max_retries = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.mysql_wsrep_sync_wait = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.pool_timeout = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.retry_interval = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.slave_connection = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.sqlite_synchronous = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.synchronous_reader = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] database.use_db_reconnect = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] profiler.connection_string = messaging:// {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] profiler.enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] profiler.es_doc_type = notification {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] profiler.es_scroll_size = 10000 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] profiler.es_scroll_time = 2m {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] profiler.filter_error_trace = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] profiler.hmac_keys = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] profiler.sentinel_service_name = mymaster {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] profiler.socket_timeout = 0.1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] profiler.trace_requests = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] profiler.trace_sqlalchemy = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] profiler_jaeger.process_tags = {} {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] profiler_jaeger.service_name_prefix = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] profiler_otlp.service_name_prefix = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_policy.enforce_new_defaults = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: WARNING oslo_config.cfg [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_policy.enforce_scope = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_policy.policy_default_rule = default {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_policy.policy_file = policy.yaml {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] privsep_osbrick.group = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] privsep_osbrick.helper_command = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] privsep_osbrick.user = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cinder_sys_admin.group = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cinder_sys_admin.helper_command = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] cinder_sys_admin.user = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] service_user.auth_section = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] service_user.auth_type = password {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] service_user.cafile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] service_user.certfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] service_user.collect_timing = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] service_user.insecure = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] service_user.keyfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] service_user.send_service_user_token = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] service_user.split_loggers = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] service_user.timeout = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance.auth_section = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance.auth_type = password {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance.certfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance.collect_timing = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance.insecure = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance.keyfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance.region_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance.split_loggers = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] glance.timeout = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.backend_availability_zone = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.chap_password = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.chap_username = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.disk_geometry = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.driver_client_cert = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.driver_client_cert_key = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.driver_data_namespace = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.driver_use_ssl = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.extra_capabilities = {} {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.filter_function = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.goodness_function = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.iscsi_target_flags = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.iscsi_write_cache = on {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.iser_helper = tgtadm {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.iser_ip_address = 192.168.122.144 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.iser_port = 3260 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.nas_host = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.nas_login = admin {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.nas_mount_options = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.nas_password = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.nas_private_key = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.nas_share_path = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.num_shell_tries = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.quobyte_volume_url = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.replication_device = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.report_discard_supported = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.reserved_percentage = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.target_helper = tgtadm {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.target_ip_address = 192.168.122.144 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.target_port = 3260 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.target_protocol = iscsi {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.trace_flags = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.unique_fqdn_network = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.use_chap_auth = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.volume_backend_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.volume_clear = zero {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.volume_clear_ionice = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.volume_clear_size = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_reports.file_event_handler = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_reports.log_dir = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.backend_availability_zone = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.backend_host = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.chap_password = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.chap_username = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.chiscsi_conf = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.disk_geometry = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.driver_client_cert = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.driver_data_namespace = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.driver_use_ssl = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.extra_capabilities = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.filter_function = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.goodness_function = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.iser_helper = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.iser_ip_address = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.iser_port = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.iser_target_prefix = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.nas_host = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.nas_login = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.nas_mount_options = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.nas_password = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.nas_private_key = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.nas_share_path = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.nas_ssh_port = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.num_shell_tries = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.nvmet_port_id = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.replication_device = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.report_discard_supported = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.reserved_percentage = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.scst_target_driver = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.storage_protocol = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.target_helper = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.target_ip_address = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.target_port = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:40 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.target_prefix = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.target_protocol = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.trace_flags = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.use_chap_auth = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.volume_clear = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.volume_clear_size = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] QuobyteHD.volumes_dir = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.ssl = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_notifications.driver = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_notifications.retry = -1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] key_manager.fixed_key = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican.barbican_api_version = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican.barbican_endpoint = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican.barbican_endpoint_type = public {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican.barbican_region_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican.cafile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican.certfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican.collect_timing = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican.insecure = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican.keyfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican.number_of_retries = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican.retry_delay = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican.send_service_user_token = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican.split_loggers = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican.timeout = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican.verify_ssl = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican.verify_ssl_path = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican_service_user.auth_section = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican_service_user.auth_type = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican_service_user.cafile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican_service_user.certfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican_service_user.collect_timing = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican_service_user.insecure = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican_service_user.keyfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican_service_user.split_loggers = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] barbican_service_user.timeout = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] vault.approle_role_id = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] vault.approle_secret_id = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] vault.kv_mountpoint = secret {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] vault.kv_path = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] vault.kv_version = 2 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack quobyte-client[86326]: Reading configuration file: /etc/quobyte/client.cfg Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] vault.namespace = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] vault.root_token_id = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] vault.ssl_ca_crt_file = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] vault.timeout = 60.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] vault.use_ssl = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:29:41 devstack quobyte-client[86326]: Invalid parameters found, error: missing mount point. Jun 02 00:29:41 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] ******************************************************************************** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 02 00:29:41 devstack quobyte-client[86326]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 02 00:29:41 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86325) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 02 00:29:41 devstack cinder-volume[86325]: WARNING cinder.volume.drivers.quobyte [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 02 00:29:41 devstack cinder-volume[86325]: WARNING cinder.volume.drivers.quobyte [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 02 00:29:41 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Running cmd (subprocess): mount.quobyte {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:29:41 devstack quobyte-client[86326]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 02 00:29:41 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] CMD "mount.quobyte" returned: 1 in 0.102s {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:29:41 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:29:41 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:29:41 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:29:41 devstack cinder-volume[86325]: INFO cinder.volume.drivers.quobyte [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 ... Jun 02 00:29:41 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e -c /etc/quobyte/client-cinder.cfg {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:29:41 devstack sudo[86332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e -c /etc/quobyte/client-cinder.cfg Jun 02 00:29:41 devstack sudo[86332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:29:41 devstack sudo[86332]: pam_unix(sudo:session): session closed for user root Jun 02 00:29:41 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.785s {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:29:41 devstack cinder-volume[86325]: INFO cinder.volume.drivers.quobyte [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 succeeded Jun 02 00:29:41 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:29:41 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.798s {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:29:41 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:29:41 devstack sudo[86415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:29:41 devstack sudo[86415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:29:42 devstack sudo[86415]: pam_unix(sudo:session): session closed for user root Jun 02 00:29:42 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.615s {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:29:42 devstack cinder-volume[86325]: INFO cinder.volume.driver [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Driver hasn't implemented _init_vendor_properties() Jun 02 00:29:42 devstack cinder-volume[86325]: DEBUG cinder.volume.driver [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86325) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 02 00:29:42 devstack cinder-volume[86325]: DEBUG oslo_db.sqlalchemy.engines [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86325) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 00:29:42 devstack cinder-volume[86325]: DEBUG dbcounter [-] [86325] Writer thread running {{(pid=86325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 00:29:42 devstack cinder-volume[86325]: DEBUG cinder.db.sqlalchemy.api [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Building query based on filter {{(pid=86325) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 02 00:29:42 devstack cinder-volume[86325]: DEBUG cinder.image.image_utils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86325) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 02 00:29:42 devstack cinder-volume[86325]: INFO cinder.keymgr.migration [None req-0e302226-c0a8-4761-a1a6-ff3593c8320b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 02 00:29:42 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:29:42 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:29:42 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:29:42 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:29:42 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:29:42 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:29:42 devstack sudo[86435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:29:42 devstack sudo[86435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:29:43 devstack sudo[86435]: pam_unix(sudo:session): session closed for user root Jun 02 00:29:43 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.555s {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:29:43 devstack cinder-volume[86325]: DEBUG cinder.manager [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Notifying Schedulers of capabilities ... {{(pid=86325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:29:43 devstack cinder-volume[86325]: INFO cinder.volume.manager [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Driver initialization completed successfully. Jun 02 00:29:43 devstack cinder-volume[86325]: INFO cinder.manager [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Initiating service 3 cleanup Jun 02 00:29:43 devstack cinder-volume[86325]: INFO cinder.manager [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Service 3 cleanup completed. Jun 02 00:29:43 devstack cinder-volume[86325]: DEBUG cinder.service [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Creating RPC server for service cinder-volume {{(pid=86325) start /opt/stack/cinder/cinder/service.py:231}} Jun 02 00:29:43 devstack cinder-volume[86325]: DEBUG cinder.service [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86325) start /opt/stack/cinder/cinder/service.py:237}} Jun 02 00:29:43 devstack cinder-volume[86325]: INFO cinder.volume.manager [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 02 00:29:43 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:29:43 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:29:43 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:29:43 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:29:43 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:29:43 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:29:43 devstack sudo[86450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:29:43 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:29:44 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root Jun 02 00:29:44 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.708s {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:29:44 devstack cinder-volume[86325]: INFO cinder.volume.manager [None req-e1fb125c-7e43-4865-aceb-6db4e2f2e780 None None] Driver post RPC initialization completed successfully. Jun 02 00:29:48 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-ca8e3a85-22ee-48f2-94fa-7ce9d7404baf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:29:48 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-ca8e3a85-22ee-48f2-94fa-7ce9d7404baf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:29:48 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-ca8e3a85-22ee-48f2-94fa-7ce9d7404baf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:29:48 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-ca8e3a85-22ee-48f2-94fa-7ce9d7404baf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:29:48 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-ca8e3a85-22ee-48f2-94fa-7ce9d7404baf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:29:48 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-ca8e3a85-22ee-48f2-94fa-7ce9d7404baf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:29:48 devstack sudo[86647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:29:48 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:29:48 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root Jun 02 00:29:48 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-ca8e3a85-22ee-48f2-94fa-7ce9d7404baf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.569s {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:29:48 devstack cinder-volume[86325]: DEBUG cinder.manager [None req-ca8e3a85-22ee-48f2-94fa-7ce9d7404baf None None] Notifying Schedulers of capabilities ... {{(pid=86325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:29:50 devstack cinder-volume[86053]: DEBUG dbcounter [-] [86053] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86053) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:29:51 devstack cinder-volume[86053]: INFO oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Caught SIGTERM, stopping children Jun 02 00:29:51 devstack cinder-volume[86053]: DEBUG oslo_concurrency.lockutils [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Acquiring lock "singleton_lock" {{(pid=86053) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 00:29:51 devstack cinder-volume[86053]: DEBUG oslo_concurrency.lockutils [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Acquired lock "singleton_lock" {{(pid=86053) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 00:29:51 devstack cinder-volume[86053]: DEBUG oslo_concurrency.lockutils [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Releasing lock "singleton_lock" {{(pid=86053) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 00:29:51 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Stop services. {{(pid=86053) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 02 00:29:51 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Killing children. {{(pid=86053) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 02 00:29:51 devstack cinder-volume[86053]: INFO oslo_service.backend._eventlet.service [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Waiting on 1 children to exit Jun 02 00:29:53 devstack cinder-volume[86325]: DEBUG dbcounter [-] [86325] Writing DB stats cinder:SELECT=4 {{(pid=86325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:29:54 devstack cinder-volume[86325]: DEBUG dbcounter [-] [86325] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:29:56 devstack cinder-volume[86325]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 02 00:29:56 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Acquiring lock "singleton_lock" {{(pid=86325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 00:29:56 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Acquired lock "singleton_lock" {{(pid=86325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 00:29:56 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Releasing lock "singleton_lock" {{(pid=86325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 00:29:56 devstack cinder-volume[86325]: WARNING amqp [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 02 00:29:56 devstack cinder-volume[86325]: WARNING amqp [None req-8aae6a62-13b1-4796-9a29-0430a86ef51e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 02 00:29:58 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 00:29:58 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 00:29:58 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 00:29:59 devstack cinder-volume[86744]: INFO dbcounter [None req-162727eb-559c-463e-8f85-22750ab92eae None None] Registered counter for database cinder Jun 02 00:29:59 devstack cinder-volume[86744]: DEBUG oslo_db.sqlalchemy.engines [None req-162727eb-559c-463e-8f85-22750ab92eae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86744) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 00:29:59 devstack cinder-volume[86744]: DEBUG dbcounter [-] [86744] Writer thread running {{(pid=86744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 00:29:59 devstack cinder-volume[86744]: INFO cinder.rpc [None req-162727eb-559c-463e-8f85-22750ab92eae None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 02 00:29:59 devstack cinder-volume[86744]: INFO cinder.rpc [None req-162727eb-559c-463e-8f85-22750ab92eae None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 02 00:29:59 devstack cinder-volume[86744]: DEBUG oslo_db.sqlalchemy.engines [None req-162727eb-559c-463e-8f85-22750ab92eae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86744) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 00:30:00 devstack cinder-volume[86744]: INFO cinder.volume.manager [None req-162727eb-559c-463e-8f85-22750ab92eae None None] Determined volume DB was empty at startup. Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG cinder.volume.manager [None req-162727eb-559c-463e-8f85-22750ab92eae None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86744) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 02 00:30:00 devstack cinder-volume[86744]: WARNING stevedore.named [None req-162727eb-559c-463e-8f85-22750ab92eae None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 02 00:30:00 devstack cinder-volume[86744]: WARNING castellan.key_manager [None req-162727eb-559c-463e-8f85-22750ab92eae None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 00:30:00 devstack cinder-volume[86744]: WARNING cinder.keymgr.conf_key_mgr [None req-162727eb-559c-463e-8f85-22750ab92eae None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 00:30:00 devstack cinder-volume[86744]: INFO cinder.volume.manager [None req-162727eb-559c-463e-8f85-22750ab92eae None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_db.sqlalchemy.engines [None req-162727eb-559c-463e-8f85-22750ab92eae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86744) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 00:30:00 devstack cinder-volume[86744]: INFO oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] Starting 1 workers Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] Started child 86910 {{(pid=86744) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] Full set of CONF: {{(pid=86744) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] ******************************************************************************** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] Configuration options gathered from: {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] ================================================================================ {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] allow_availability_zone_fallback = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] allow_compression_on_image_upload = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] allowed_direct_url_schemes = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86910]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] api_rate_limit = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] auth_strategy = keystone {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_availability_zone = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_host = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_stats_polling_interval = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backup_api_class = cinder.backup.api.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backup_name_template = backup-%s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backup_use_same_host = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backup_use_temp_snapshot = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] chap_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] chap_username = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cinder_internal_tenant_project_id = 165f7838b0954c3f973eb38a00360bba {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cinder_internal_tenant_user_id = 177e22fedc1248bcaa4a16fdd1e27e99 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cluster = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] compression_format = gzip {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] compute_api_class = cinder.compute.nova.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] config_dir = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] config_source = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] control_exchange = openstack {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] debug = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] default_availability_zone = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] default_group_type = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] default_volume_type = QuobyteHD {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] disk_geometry = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] driver_client_cert = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] driver_client_cert_key = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] driver_data_namespace = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] driver_ssl_cert_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] driver_ssl_cert_verify = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] driver_use_ssl = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] enable_new_services = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] enable_unsupported_driver = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] enabled_backends = ['QuobyteHD'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] enforce_multipath_for_image_xfer = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] filter_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance_api_insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance_api_servers = ['http://192.168.122.144/image'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance_api_ssl_compression = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance_ca_certificates_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance_catalog_info = image:glance:publicURL {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance_certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance_keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance_num_retries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance_request_timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] goodness_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] graceful_shutdown_timeout = 5 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] group_api_class = cinder.group.api.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] host = devstack {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] image_compress_on_upload = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] image_conversion_address_space_limit = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] image_conversion_cpu_limit = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] image_conversion_disable = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] image_upload_use_cinder_backend = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] image_upload_use_internal_tenant = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] image_volume_cache_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] image_volume_cache_max_count = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] image_volume_cache_max_size_gb = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] init_host_max_objects_retrieval = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] instance_format = [instance: %(uuid)s] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] iscsi_target_flags = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] iscsi_write_cache = on {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] iser_helper = tgtadm {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] iser_ip_address = 192.168.122.144 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] iser_port = 3260 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] log_color = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] log_config_append = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] log_dir = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] log_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] log_options = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] log_rotate_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] log_rotate_interval_type = days {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] log_rotation_type = none {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] max_age = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] max_logfile_count = 30 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] max_logfile_size_mb = 200 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] max_over_subscription_ratio = 20.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] message_reap_interval = 86400 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] message_ttl = 2592000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] migration_create_volume_timeout_secs = 300 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] monkey_patch = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] monkey_patch_modules = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] my_ip = 192.168.122.144 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] no_snapshot_gb_quota = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] num_iser_scan_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] num_shell_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] num_volume_device_scan_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] nvmeof_conn_info_version = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] nvmet_ns_id = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] nvmet_port_id = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86910) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] osapi_max_limit = 1000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] osapi_volume_ext_list = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] osapi_volume_listen = 0.0.0.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] osapi_volume_listen_port = 8776 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] osapi_volume_use_ssl = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] osapi_volume_workers = 2 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] per_volume_size_limit = -1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] periodic_fuzzy_delay = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] periodic_interval = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] project_id_regex = [0-9a-f\-]+ {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] public_endpoint = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] publish_errors = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] quota_backup_gigabytes = 1000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] quota_backups = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] quota_gigabytes = 1000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] quota_groups = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] quota_snapshots = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] quota_volumes = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] rate_limit_burst = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] rate_limit_except_level = CRITICAL {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] rate_limit_interval = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] reinit_driver_count = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] replication_device = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] report_discard_supported = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] report_interval = 120 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] reservation_clean_interval = 86400 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] reservation_expire = 86400 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] reserved_image_namespaces = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] reserved_percentage = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] rpc_response_timeout = 120 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] run_external_periodic_tasks = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] scst_target_driver = iscsi {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] scst_target_iqn_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] service_down_time = 720 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] shell_completion = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] snapshot_name_template = snapshot-%s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] split_loggers = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] state_path = /opt/stack/data/cinder {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] storage_availability_zone = nova {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] storage_protocol = iSCSI {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] syslog_log_facility = LOG_USER {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] target_helper = lioadm {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] target_ip_address = 192.168.122.144 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] target_port = 3260 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] target_protocol = iscsi {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] target_secondary_ip_addresses = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] trace_flags = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] transfer_api_class = cinder.transfer.api.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] transport_url = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] until_refresh = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] use_chap_auth = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] use_default_quota_class = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] use_journal = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] use_json = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] use_multipath_for_image_xfer = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] use_stderr = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] use_syslog = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] verify_glance_signatures = enabled {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] volume_api_class = cinder.volume.api.API {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] volume_backend_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] volume_clear = zero {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] volume_clear_ionice = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] volume_clear_size = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] volume_copy_bps_limit = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] volume_dd_blocksize = 1M {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] volume_name_template = volume-%s {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] volume_service_inithost_offload = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] volume_usage_audit_period = month {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] zoning_mode = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_concurrency.disable_process_locking = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.admin_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.admin_tenant_name = admin {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.admin_token = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.admin_user = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.auth_admin_prefix = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.auth_port = 35357 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.auth_protocol = https {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.auth_section = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.auth_type = password {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.auth_uri = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.auth_version = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.cache = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.delay_auth_decision = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.http_connect_timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.identity_uri = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.include_service_catalog = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.interface = public {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.memcache_password = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.memcache_username = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.region_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.service_token_roles_required = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.service_type = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.token_cache_time = 300 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.144/identity {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.backend = dogpile.cache.null {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.backend_argument = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.backend_expiration_time = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.config_prefix = cache.oslo {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.debug_cache_backend = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.enable_retry_client = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.enable_socket_keepalive = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.enforce_fips_mode = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.expiration_time = 600 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.hashclient_retry_attempts = 2 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.memcache_dead_retry = 300 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.memcache_pool_maxsize = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.memcache_sasl_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.proxies = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.redis_db = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.redis_sentinel_service_name = mymaster {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.redis_server = localhost:6379 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.retry_attempts = 2 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.retry_delay = 0.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.socket_keepalive_count = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.socket_keepalive_idle = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.socket_keepalive_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.socket_timeout = 1.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.tls_allowed_ciphers = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.tls_cafile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.tls_certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.tls_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.tls_keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cache.username = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] coordination.backend_url = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.asyncio_connection = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.asyncio_slave_connection = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.backend = sqlalchemy {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.connection = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.connection_debug = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86910) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 02 00:30:00 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.quobyte [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.connection_parameters = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.quobyte [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.connection_recycle_time = 3600 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.connection_trace = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.db_inc_retry_interval = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.db_max_retries = 20 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Running cmd (subprocess): mount.quobyte {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.db_max_retry_interval = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.db_retry_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.max_overflow = 50 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.max_pool_size = 5 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.max_retries = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.mysql_wsrep_sync_wait = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.pool_timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.retry_interval = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.slave_connection = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.sqlite_synchronous = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.synchronous_reader = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] database.use_db_reconnect = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] profiler.connection_string = messaging:// {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] profiler.enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] profiler.es_doc_type = notification {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] profiler.es_scroll_size = 10000 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] profiler.es_scroll_time = 2m {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] profiler.filter_error_trace = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] profiler.hmac_keys = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] profiler.sentinel_service_name = mymaster {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] profiler.socket_timeout = 0.1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] profiler.trace_requests = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] profiler.trace_sqlalchemy = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] profiler_jaeger.process_tags = {} {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] profiler_jaeger.service_name_prefix = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] profiler_otlp.service_name_prefix = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_policy.enforce_new_defaults = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: WARNING oslo_config.cfg [None req-162727eb-559c-463e-8f85-22750ab92eae None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_policy.enforce_scope = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_policy.policy_default_rule = default {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_policy.policy_file = policy.yaml {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_policy.remote_timeout = 60.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] privsep_osbrick.group = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] privsep_osbrick.helper_command = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] privsep_osbrick.user = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cinder_sys_admin.group = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cinder_sys_admin.helper_command = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] cinder_sys_admin.user = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] service_user.auth_section = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] service_user.auth_type = password {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] service_user.cafile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] service_user.certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] service_user.collect_timing = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] service_user.insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] service_user.keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] service_user.send_service_user_token = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] service_user.split_loggers = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] service_user.timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance.auth_section = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance.auth_type = password {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance.certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance.collect_timing = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance.insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance.keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance.region_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance.split_loggers = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] glance.timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.backend_availability_zone = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.chap_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.chap_username = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.disk_geometry = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.driver_client_cert = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.driver_client_cert_key = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.driver_data_namespace = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.driver_use_ssl = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.enable_unsupported_driver = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.extra_capabilities = {} {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.filter_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.goodness_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.iscsi_target_flags = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.iscsi_write_cache = on {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.iser_helper = tgtadm {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.iser_ip_address = 192.168.122.144 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.iser_port = 3260 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.nas_host = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.nas_login = admin {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.nas_mount_options = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.nas_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.nas_private_key = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.nas_share_path = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.nas_ssh_port = 22 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.num_shell_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.nvmet_port_id = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.quobyte_client_cfg = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.quobyte_volume_url = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.replication_device = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.report_discard_supported = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.reserved_percentage = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.scst_target_driver = iscsi {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.scst_target_iqn_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.storage_protocol = iSCSI {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.target_helper = tgtadm {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.target_ip_address = 192.168.122.144 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.target_port = 3260 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.target_protocol = iscsi {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.trace_flags = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.unique_fqdn_network = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.use_chap_auth = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.volume_backend_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.volume_clear = zero {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.volume_clear_ionice = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.volume_clear_size = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_reports.file_event_handler = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_reports.log_dir = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.backend_availability_zone = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.backend_host = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.chap_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.chap_username = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.chiscsi_conf = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.disk_geometry = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.driver_client_cert = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.driver_client_cert_key = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.driver_data_namespace = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.driver_use_ssl = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.extra_capabilities = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.filter_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.goodness_function = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack quobyte-client[86911]: Reading configuration file: /etc/quobyte/client.cfg Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.iscsi_target_flags = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.iscsi_write_cache = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack quobyte-client[86911]: Invalid parameters found, error: missing mount point. Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.iser_helper = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.iser_ip_address = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.iser_port = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.iser_target_prefix = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack quobyte-client[86911]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.nas_host = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.nas_login = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.nas_mount_options = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack quobyte-client[86911]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] CMD "mount.quobyte" returned: 1 in 0.063s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.nas_password = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.nas_private_key = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.nas_share_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.nas_ssh_port = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.num_shell_tries = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.nvmet_ns_id = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.nvmet_port_id = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.replication_device = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.report_discard_supported = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.reserved_percentage = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.scst_target_driver = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.storage_protocol = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.target_helper = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.target_ip_address = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.target_port = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.target_prefix = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.target_protocol = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.trace_flags = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.unique_fqdn_network = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.use_chap_auth = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.volume_clear = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.volume_clear_ionice = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.volume_clear_size = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] QuobyteHD.volumes_dir = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.ssl = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack sudo[86912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.ssl_version = {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_notifications.driver = [] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_notifications.retry = -1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] oslo_messaging_notifications.transport_url = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] key_manager.fixed_key = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican.barbican_api_version = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican.barbican_endpoint = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican.barbican_endpoint_type = public {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican.barbican_region_name = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican.cafile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican.certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican.collect_timing = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican.insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican.keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican.number_of_retries = 60 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican.retry_delay = 1 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican.send_service_user_token = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican.split_loggers = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican.timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican.verify_ssl = True {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican.verify_ssl_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican_service_user.auth_section = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican_service_user.auth_type = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican_service_user.cafile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican_service_user.certfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican_service_user.collect_timing = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican_service_user.insecure = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican_service_user.keyfile = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican_service_user.split_loggers = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] barbican_service_user.timeout = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] vault.approle_role_id = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] vault.approle_secret_id = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] vault.kv_mountpoint = secret {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] vault.kv_path = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] vault.kv_version = 2 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] vault.namespace = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] vault.root_token_id = **** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] vault.ssl_ca_crt_file = None {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] vault.timeout = 60.0 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] vault.use_ssl = False {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 00:30:00 devstack cinder-volume[86744]: DEBUG oslo_service.backend._eventlet.service [None req-162727eb-559c-463e-8f85-22750ab92eae None None] ******************************************************************************** {{(pid=86744) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 02 00:30:00 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.582s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:30:00 devstack cinder-volume[86910]: INFO cinder.volume.driver [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Driver hasn't implemented _init_vendor_properties() Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG cinder.volume.driver [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86910) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG oslo_db.sqlalchemy.engines [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writer thread running {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG cinder.db.sqlalchemy.api [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Building query based on filter {{(pid=86910) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86910) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:30:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:30:00 devstack cinder-volume[86910]: INFO cinder.keymgr.migration [None req-93350ebc-060b-4d60-8ebf-effe27de3670 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 02 00:30:00 devstack sudo[86915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:30:00 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:30:01 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root Jun 02 00:30:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.580s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:30:01 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:30:01 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Driver initialization completed successfully. Jun 02 00:30:01 devstack cinder-volume[86910]: INFO cinder.manager [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Initiating service 3 cleanup Jun 02 00:30:01 devstack cinder-volume[86910]: INFO cinder.manager [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Service 3 cleanup completed. Jun 02 00:30:01 devstack cinder-volume[86910]: DEBUG cinder.service [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Creating RPC server for service cinder-volume {{(pid=86910) start /opt/stack/cinder/cinder/service.py:231}} Jun 02 00:30:01 devstack cinder-volume[86910]: DEBUG cinder.service [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86910) start /opt/stack/cinder/cinder/service.py:237}} Jun 02 00:30:01 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 02 00:30:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:30:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:30:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:30:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:30:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:30:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:30:01 devstack sudo[86919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:30:01 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:30:02 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root Jun 02 00:30:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.561s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:30:02 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a41dfce6-7b53-4ae7-adcd-7b06876cce16 None None] Driver post RPC initialization completed successfully. Jun 02 00:30:10 devstack cinder-volume[86744]: DEBUG dbcounter [-] [86744] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:30:11 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:30:12 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:31:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:31:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:31:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:31:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:31:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:31:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:31:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:31:15 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:31:15 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:31:16 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Jun 02 00:31:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.242s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:31:16 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Flow 'volume_create_manager' (b2df3969-3856-4fb7-9315-199ffe23685c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91699486-46f5-4444-b83e-802f19663faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91699486-46f5-4444-b83e-802f19663faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-41332186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c5752f-5a9b-47b0-8949-ad0e11e57639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45d9a92a5284e97b8638d31dc717927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:31:19Z,use_quota=True,user_id='c44a54d0c0824a2a980690ca9c7df028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d5a2fdf-fe1c-4e79-b55a-5ad85e9a92b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d5a2fdf-fe1c-4e79-b55a-5ad85e9a92b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7d8349-5595-489d-9d08-d0312a1d6724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7d8349-5595-489d-9d08-d0312a1d6724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69c5752f-5a9b-47b0-8949-ad0e11e57639', 'volume_name': 'volume-69c5752f-5a9b-47b0-8949-ad0e11e57639', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3d97cb-2e1b-41ce-adf0-4ed1a8730807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3d97cb-2e1b-41ce-adf0-4ed1a8730807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82bbdcb-3c1e-4ed7-9d17-a76351ffd3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:19 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Volume 69c5752f-5a9b-47b0-8949-ad0e11e57639: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69c5752f-5a9b-47b0-8949-ad0e11e57639', 'volume_size': 1} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-41332186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c5752f-5a9b-47b0-8949-ad0e11e57639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45d9a92a5284e97b8638d31dc717927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:31:19Z,use_quota=True,user_id='c44a54d0c0824a2a980690ca9c7df028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Creating volume 69c5752f-5a9b-47b0-8949-ad0e11e57639 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:31:19 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:31:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-69c5752f-5a9b-47b0-8949-ad0e11e57639 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:31:19 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-69c5752f-5a9b-47b0-8949-ad0e11e57639 1073741824 Jun 02 00:31:19 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:31:20 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Jun 02 00:31:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-69c5752f-5a9b-47b0-8949-ad0e11e57639 1073741824" returned: 0 in 1.082s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:31:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-69c5752f-5a9b-47b0-8949-ad0e11e57639 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:31:20 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-69c5752f-5a9b-47b0-8949-ad0e11e57639 Jun 02 00:31:20 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:31:21 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Jun 02 00:31:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-69c5752f-5a9b-47b0-8949-ad0e11e57639" returned: 0 in 0.755s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:31:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:31:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:31:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82bbdcb-3c1e-4ed7-9d17-a76351ffd3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69c5752f-5a9b-47b0-8949-ad0e11e57639', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153a0961-7c0e-40eb-953a-0e831b1e8f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:21 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Volume volume-69c5752f-5a9b-47b0-8949-ad0e11e57639 (69c5752f-5a9b-47b0-8949-ad0e11e57639): created successfully Jun 02 00:31:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153a0961-7c0e-40eb-953a-0e831b1e8f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Flow 'volume_create_manager' (b2df3969-3856-4fb7-9315-199ffe23685c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:31:21 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a519a4c2-a6c0-434b-859a-0d7f84c86494 tempest-DeleteServersTestJSON-1216121185 None] Created volume successfully. Jun 02 00:31:29 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Flow 'volume_create_manager' (ce651b24-ee4a-42e2-9e7f-ca42fd68c29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893e77c6-dce2-410f-a602-52658b639183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893e77c6-dce2-410f-a602-52658b639183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1370850789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ccc125f-761c-40fc-a7ce-047b11a20706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7db8d7d25dc4d5eb6e18f5e6ddf58f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:31:30Z,use_quota=True,user_id='3f2968e3b80d4a769e68963e58727539',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdb409e-1803-4726-9dfe-acdbc5e2e513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdb409e-1803-4726-9dfe-acdbc5e2e513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7830fa-f7de-4d75-9f46-f374dc721032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7830fa-f7de-4d75-9f46-f374dc721032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ccc125f-761c-40fc-a7ce-047b11a20706', 'volume_name': 'volume-2ccc125f-761c-40fc-a7ce-047b11a20706', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707dae2a-9562-4b07-807d-50ef1cbdc1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707dae2a-9562-4b07-807d-50ef1cbdc1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb54a57-9060-4112-b40b-62fc47c36465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:30 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Volume 2ccc125f-761c-40fc-a7ce-047b11a20706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ccc125f-761c-40fc-a7ce-047b11a20706', 'volume_size': 1} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1370850789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ccc125f-761c-40fc-a7ce-047b11a20706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7db8d7d25dc4d5eb6e18f5e6ddf58f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:31:30Z,use_quota=True,user_id='3f2968e3b80d4a769e68963e58727539',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Creating volume 2ccc125f-761c-40fc-a7ce-047b11a20706 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:31:30 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ccc125f-761c-40fc-a7ce-047b11a20706 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:31:30 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ccc125f-761c-40fc-a7ce-047b11a20706 1073741824 Jun 02 00:31:30 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:31:30 devstack cinder-volume[86910]: WARNING py.warnings [req-e1da05b8-2b00-457e-a3f8-67a1ed7676d8 req-f49f11a4-b870-42a2-9aea-fcfb40455fb3 tempest-DeleteServersTestJSON-1216121185 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jun 02 00:31:30 devstack cinder-volume[86910]: .first() Jun 02 00:31:30 devstack cinder-volume[86910]: Jun 02 00:31:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-e1da05b8-2b00-457e-a3f8-67a1ed7676d8 req-f49f11a4-b870-42a2-9aea-fcfb40455fb3 tempest-DeleteServersTestJSON-1216121185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:31:31 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Jun 02 00:31:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ccc125f-761c-40fc-a7ce-047b11a20706 1073741824" returned: 0 in 1.302s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:31:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ccc125f-761c-40fc-a7ce-047b11a20706 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:31:31 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ccc125f-761c-40fc-a7ce-047b11a20706 Jun 02 00:31:31 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:31:32 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Jun 02 00:31:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ccc125f-761c-40fc-a7ce-047b11a20706" returned: 0 in 1.421s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:31:32 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] <== create_volume: return (2811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:31:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.813s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:31:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-e1da05b8-2b00-457e-a3f8-67a1ed7676d8 req-f49f11a4-b870-42a2-9aea-fcfb40455fb3 tempest-DeleteServersTestJSON-1216121185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.585s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:31:33 devstack cinder-volume[86910]: INFO oslo.privsep.daemon [req-e1da05b8-2b00-457e-a3f8-67a1ed7676d8 req-f49f11a4-b870-42a2-9aea-fcfb40455fb3 tempest-DeleteServersTestJSON-1216121185 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp99z9vb6w/privsep.sock'] Jun 02 00:31:33 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp99z9vb6w/privsep.sock Jun 02 00:31:33 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:31:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb54a57-9060-4112-b40b-62fc47c36465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ccc125f-761c-40fc-a7ce-047b11a20706', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1d1247-7e90-4273-bf20-c6a4dd06a5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:33 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Volume volume-2ccc125f-761c-40fc-a7ce-047b11a20706 (2ccc125f-761c-40fc-a7ce-047b11a20706): created successfully Jun 02 00:31:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1d1247-7e90-4273-bf20-c6a4dd06a5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Flow 'volume_create_manager' (ce651b24-ee4a-42e2-9e7f-ca42fd68c29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:31:33 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-529cc945-acda-4293-8d2c-af1b50ec6d60 tempest-VolumesAdminNegativeTest-1919440997 None] Created volume successfully. Jun 02 00:31:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Acquiring lock "cinder-2ccc125f-761c-40fc-a7ce-047b11a20706-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:31:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Lock "cinder-2ccc125f-761c-40fc-a7ce-047b11a20706-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:31:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Acquiring lock "cinder-quobyte-2ccc125f-761c-40fc-a7ce-047b11a20706" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:31:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Lock "cinder-quobyte-2ccc125f-761c-40fc-a7ce-047b11a20706" acquired by "delete_volume" :: waited 0.042s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:31:35 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Jun 02 00:31:35 devstack cinder-volume[86910]: INFO oslo.privsep.daemon [req-e1da05b8-2b00-457e-a3f8-67a1ed7676d8 req-f49f11a4-b870-42a2-9aea-fcfb40455fb3 tempest-DeleteServersTestJSON-1216121185 None] Spawned new privsep daemon via rootwrap Jun 02 00:31:35 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [req-e1da05b8-2b00-457e-a3f8-67a1ed7676d8 req-f49f11a4-b870-42a2-9aea-fcfb40455fb3 tempest-DeleteServersTestJSON-1216121185 None] Accepted privsep connection to /tmp/tmp99z9vb6w/privsep.sock {{(pid=86910) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Jun 02 00:31:35 devstack cinder-volume[86910]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 02 00:31:35 devstack cinder-volume[86910]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 02 00:31:35 devstack cinder-volume[86910]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 02 00:31:35 devstack cinder-volume[86910]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87934 Jun 02 00:31:35 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d465fee-62c6-4c3e-a087-557dffddf0ef]: (2,) {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:31:35 devstack cinder-volume[86910]: WARNING oslo_privsep.priv_context [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] privsep daemon already running Jun 02 00:31:35 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0301b28-2c8b-4aa8-bca2-bdcb0d5dfd9a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:31:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-e1da05b8-2b00-457e-a3f8-67a1ed7676d8 req-f49f11a4-b870-42a2-9aea-fcfb40455fb3 tempest-DeleteServersTestJSON-1216121185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-69c5752f-5a9b-47b0-8949-ad0e11e57639 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:31:35 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2789ea9-db26-428a-b109-e0669582812d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:31:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ccc125f-761c-40fc-a7ce-047b11a20706 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:31:36 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ccc125f-761c-40fc-a7ce-047b11a20706 Jun 02 00:31:36 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:31:36 devstack sudo[87939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-69c5752f-5a9b-47b0-8949-ad0e11e57639 Jun 02 00:31:36 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:31:37 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Jun 02 00:31:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ccc125f-761c-40fc-a7ce-047b11a20706" returned: 0 in 1.614s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:31:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ccc125f-761c-40fc-a7ce-047b11a20706 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:31:37 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ccc125f-761c-40fc-a7ce-047b11a20706 Jun 02 00:31:37 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:31:37 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root Jun 02 00:31:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-e1da05b8-2b00-457e-a3f8-67a1ed7676d8 req-f49f11a4-b870-42a2-9aea-fcfb40455fb3 tempest-DeleteServersTestJSON-1216121185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-69c5752f-5a9b-47b0-8949-ad0e11e57639" returned: 0 in 1.769s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:31:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-e1da05b8-2b00-457e-a3f8-67a1ed7676d8 req-f49f11a4-b870-42a2-9aea-fcfb40455fb3 tempest-DeleteServersTestJSON-1216121185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.526s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:31:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-e1da05b8-2b00-457e-a3f8-67a1ed7676d8 req-f49f11a4-b870-42a2-9aea-fcfb40455fb3 tempest-DeleteServersTestJSON-1216121185 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-69c5752f-5a9b-47b0-8949-ad0e11e57639', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7baae031-7e6e-4dae-8e69-938ab849e990', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:31:37 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-e1da05b8-2b00-457e-a3f8-67a1ed7676d8 req-f49f11a4-b870-42a2-9aea-fcfb40455fb3 tempest-DeleteServersTestJSON-1216121185 None] attachment_update completed successfully. Jun 02 00:31:38 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Jun 02 00:31:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ccc125f-761c-40fc-a7ce-047b11a20706" returned: 0 in 1.009s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:31:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Lock "cinder-quobyte-2ccc125f-761c-40fc-a7ce-047b11a20706" released by "delete_volume" :: held 3.725s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:31:38 devstack cinder-volume[86910]: WARNING cinder.quota [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:31:38 devstack cinder-volume[86910]: WARNING cinder.quota [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:31:38 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Created reservations ['e9d23a07-1790-48ac-b4db-1dbbff4ad9a9', 'bf17ecc4-1faa-4995-ad79-18387d2ee0ec', '9d80a14f-16c1-4df8-b905-dd04a670c006', 'eb7f053d-031d-4227-9a9a-62573f1efa4b'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:31:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:31:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:31:38 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:31:38 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:31:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:31:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:31:38 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:31:38 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:31:40 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Jun 02 00:31:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.319s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:31:40 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:31:40 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Deleted volume successfully. Jun 02 00:31:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-39d1863b-e929-4798-a8ae-2b9dcb0daea9 tempest-VolumesAdminNegativeTest-1919440997 None] Lock "cinder-2ccc125f-761c-40fc-a7ce-047b11a20706-delete_volume" released by "delete_volume" :: held 5.590s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:31:48 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-f9532ea2-e6a2-4cf8-a113-7fa144a4af20 req-ddfe59c9-b483-4f37-a42d-867f54980c2d tempest-DeleteServersTestJSON-1216121185 None] Terminate volume connection completed successfully. Jun 02 00:31:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-f9532ea2-e6a2-4cf8-a113-7fa144a4af20 req-ddfe59c9-b483-4f37-a42d-867f54980c2d tempest-DeleteServersTestJSON-1216121185 None] Deleting attachment 7baae031-7e6e-4dae-8e69-938ab849e990. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:31:52 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] Acquiring lock "cinder-69c5752f-5a9b-47b0-8949-ad0e11e57639-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:31:52 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] Lock "cinder-69c5752f-5a9b-47b0-8949-ad0e11e57639-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:31:52 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] Acquiring lock "cinder-quobyte-69c5752f-5a9b-47b0-8949-ad0e11e57639" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:31:52 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] Lock "cinder-quobyte-69c5752f-5a9b-47b0-8949-ad0e11e57639" acquired by "delete_volume" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:31:52 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[12598f35-c2b7-4f9e-a145-d35a4fddc8cb]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:31:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-69c5752f-5a9b-47b0-8949-ad0e11e57639 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:31:52 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-69c5752f-5a9b-47b0-8949-ad0e11e57639 Jun 02 00:31:52 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:31:53 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Jun 02 00:31:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-69c5752f-5a9b-47b0-8949-ad0e11e57639" returned: 0 in 0.913s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:31:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-69c5752f-5a9b-47b0-8949-ad0e11e57639 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:31:53 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-69c5752f-5a9b-47b0-8949-ad0e11e57639 Jun 02 00:31:53 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:31:54 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Jun 02 00:31:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-69c5752f-5a9b-47b0-8949-ad0e11e57639" returned: 0 in 0.818s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:31:54 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] Lock "cinder-quobyte-69c5752f-5a9b-47b0-8949-ad0e11e57639" released by "delete_volume" :: held 1.801s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:31:54 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] Created reservations ['195871a8-9ee1-467c-b065-9890114d2565', '00b090ea-3845-47d8-bca1-32e0436ea561', 'd6b19e4a-2e95-44df-a41c-3d5766641b17', 'c45c15b6-32eb-4e61-9f68-9c2c3867fac1'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:31:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:31:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:31:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:31:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:31:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:31:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:31:54 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:31:54 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:31:55 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Jun 02 00:31:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.792s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:31:55 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:31:55 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] Deleted volume successfully. Jun 02 00:31:55 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-15493851-ba4e-4d8e-bac3-533cceba283e tempest-DeleteServersTestJSON-1216121185 None] Lock "cinder-69c5752f-5a9b-47b0-8949-ad0e11e57639-delete_volume" released by "delete_volume" :: held 2.862s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:31:57 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Flow 'volume_create_manager' (a3d3e10f-8024-42c3-a96c-9f4290c9f7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61589e0e-d6e7-4927-93c0-0f874597cdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61589e0e-d6e7-4927-93c0-0f874597cdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-220502087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3addbc58-2c25-4aab-8e74-cbd845e9397d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa77ddda1d6d41efae7394c5aea8b04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:31:58Z,use_quota=True,user_id='51db0168259c4db69bc6fb0f9e23b725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788befc8-1c9c-4a24-ae9a-54917b6b5773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788befc8-1c9c-4a24-ae9a-54917b6b5773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d33b56c-764c-44f0-b3d3-1eb7e99535f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d33b56c-764c-44f0-b3d3-1eb7e99535f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3addbc58-2c25-4aab-8e74-cbd845e9397d', 'volume_name': 'volume-3addbc58-2c25-4aab-8e74-cbd845e9397d', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37db161-89a7-48d6-9043-b78661730ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37db161-89a7-48d6-9043-b78661730ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9b1224-c0c2-4421-a2ae-8b59146e4e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:58 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Volume 3addbc58-2c25-4aab-8e74-cbd845e9397d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3addbc58-2c25-4aab-8e74-cbd845e9397d', 'volume_size': 1} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-220502087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3addbc58-2c25-4aab-8e74-cbd845e9397d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa77ddda1d6d41efae7394c5aea8b04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:31:58Z,use_quota=True,user_id='51db0168259c4db69bc6fb0f9e23b725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Creating volume 3addbc58-2c25-4aab-8e74-cbd845e9397d {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:31:58 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:31:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:31:58 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d 1073741824 Jun 02 00:31:58 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:31:59 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Jun 02 00:31:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d 1073741824" returned: 0 in 1.097s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:31:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:31:59 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d Jun 02 00:31:59 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:31:59 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Jun 02 00:31:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d" returned: 0 in 0.638s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:31:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:31:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:31:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9b1224-c0c2-4421-a2ae-8b59146e4e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3addbc58-2c25-4aab-8e74-cbd845e9397d', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b8eddb-8a0e-4655-83bb-49876aa979e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:31:59 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Volume volume-3addbc58-2c25-4aab-8e74-cbd845e9397d (3addbc58-2c25-4aab-8e74-cbd845e9397d): created successfully Jun 02 00:31:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b8eddb-8a0e-4655-83bb-49876aa979e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:31:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Flow 'volume_create_manager' (a3d3e10f-8024-42c3-a96c-9f4290c9f7de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:31:59 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-4d001dda-0209-4392-a655-241db7fb498a tempest-ServerActionsTestOtherA-544903603 None] Created volume successfully. Jun 02 00:32:12 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=20,cinder:SELECT=26,cinder:INSERT=5,cinder:DELETE=3 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:32:12 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=20,cinder:UPDATE=34,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:32:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:32:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:32:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:32:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:32:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:32:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:32:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:32:15 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:32:15 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:32:16 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Jun 02 00:32:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.129s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:32:16 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Flow 'volume_create_manager' (3b72c87e-fe7c-4705-b0eb-8b4d66ae206f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5186bce-4a41-4d19-b72e-5fc161295520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5186bce-4a41-4d19-b72e-5fc161295520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1851301324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340b089f-4f5c-45f4-932e-a29772ff4b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc2df18550c49da9accc3373be52970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:32:40Z,use_quota=True,user_id='6405406ca25b470ab3c71b50e7358dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2720d9-64c1-4375-bdb2-feffe0f63deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2720d9-64c1-4375-bdb2-feffe0f63deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bdc16c2-68cf-4321-8bcb-c18ed7d2ca8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bdc16c2-68cf-4321-8bcb-c18ed7d2ca8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '340b089f-4f5c-45f4-932e-a29772ff4b34', 'volume_name': 'volume-340b089f-4f5c-45f4-932e-a29772ff4b34', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b303b71c-5b4d-4bcd-a043-434cfdca2830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b303b71c-5b4d-4bcd-a043-434cfdca2830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f604646-c6c6-4736-a6bd-d586102abbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:32:40 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Volume 340b089f-4f5c-45f4-932e-a29772ff4b34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-340b089f-4f5c-45f4-932e-a29772ff4b34', 'volume_size': 1} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1851301324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340b089f-4f5c-45f4-932e-a29772ff4b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc2df18550c49da9accc3373be52970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:32:40Z,use_quota=True,user_id='6405406ca25b470ab3c71b50e7358dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Creating volume 340b089f-4f5c-45f4-932e-a29772ff4b34 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:32:40 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:32:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-340b089f-4f5c-45f4-932e-a29772ff4b34 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:32:40 devstack sudo[88970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-340b089f-4f5c-45f4-932e-a29772ff4b34 1073741824 Jun 02 00:32:40 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:32:41 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root Jun 02 00:32:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-340b089f-4f5c-45f4-932e-a29772ff4b34 1073741824" returned: 0 in 1.240s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:32:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-340b089f-4f5c-45f4-932e-a29772ff4b34 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:32:41 devstack sudo[88979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-340b089f-4f5c-45f4-932e-a29772ff4b34 Jun 02 00:32:41 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:32:42 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root Jun 02 00:32:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-340b089f-4f5c-45f4-932e-a29772ff4b34" returned: 0 in 1.351s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:32:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] <== create_volume: return (2672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:32:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.674s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:32:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f604646-c6c6-4736-a6bd-d586102abbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-340b089f-4f5c-45f4-932e-a29772ff4b34', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:32:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a748377-8516-4117-aa21-764d2136bd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:32:43 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Volume volume-340b089f-4f5c-45f4-932e-a29772ff4b34 (340b089f-4f5c-45f4-932e-a29772ff4b34): created successfully Jun 02 00:32:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a748377-8516-4117-aa21-764d2136bd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:32:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Flow 'volume_create_manager' (3b72c87e-fe7c-4705-b0eb-8b4d66ae206f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:32:43 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-51694878-51a7-43bb-b800-8d0bc2e34ce0 tempest-ServerRescueNegativeTestJSON-1211436495 None] Created volume successfully. Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Flow 'volume_create_manager' (3cddccdc-4888-4aff-9a16-e2186cf71cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae242f5-0be4-4d71-b3ce-73a87f44fa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae242f5-0be4-4d71-b3ce-73a87f44fa52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2108327432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=246ed45d-1f5e-4e86-8538-2aad4250be6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497480d992c54a758dcfbf8b00972d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:32:44Z,use_quota=True,user_id='fe773c1809c447adaf2a54b7f14cdc9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ff01a3-32ba-4167-8d1f-da953fcc103a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ff01a3-32ba-4167-8d1f-da953fcc103a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33269bbc-ab6c-4a8c-a98f-d33b102c6e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33269bbc-ab6c-4a8c-a98f-d33b102c6e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '246ed45d-1f5e-4e86-8538-2aad4250be6f', 'volume_name': 'volume-246ed45d-1f5e-4e86-8538-2aad4250be6f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daaa0e3a-93c6-47a0-8865-cbb209fb7e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daaa0e3a-93c6-47a0-8865-cbb209fb7e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (115183df-79a1-4f1f-8c4a-5c9dffe3b3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:32:44 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Volume 246ed45d-1f5e-4e86-8538-2aad4250be6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-246ed45d-1f5e-4e86-8538-2aad4250be6f', 'volume_size': 1} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2108327432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=246ed45d-1f5e-4e86-8538-2aad4250be6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497480d992c54a758dcfbf8b00972d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:32:44Z,use_quota=True,user_id='fe773c1809c447adaf2a54b7f14cdc9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Creating volume 246ed45d-1f5e-4e86-8538-2aad4250be6f {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:32:44 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:32:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-246ed45d-1f5e-4e86-8538-2aad4250be6f 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:32:44 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-246ed45d-1f5e-4e86-8538-2aad4250be6f 1073741824 Jun 02 00:32:44 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:32:46 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Jun 02 00:32:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-246ed45d-1f5e-4e86-8538-2aad4250be6f 1073741824" returned: 0 in 1.738s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:32:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-246ed45d-1f5e-4e86-8538-2aad4250be6f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:32:46 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-246ed45d-1f5e-4e86-8538-2aad4250be6f Jun 02 00:32:46 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:32:47 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Jun 02 00:32:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-246ed45d-1f5e-4e86-8538-2aad4250be6f" returned: 0 in 0.741s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:32:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] <== create_volume: return (2578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:32:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.588s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:32:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (115183df-79a1-4f1f-8c4a-5c9dffe3b3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-246ed45d-1f5e-4e86-8538-2aad4250be6f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:32:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f889be4c-225c-4900-bb8e-38b0f5187f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:32:47 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Volume volume-246ed45d-1f5e-4e86-8538-2aad4250be6f (246ed45d-1f5e-4e86-8538-2aad4250be6f): created successfully Jun 02 00:32:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f889be4c-225c-4900-bb8e-38b0f5187f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:32:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Flow 'volume_create_manager' (3cddccdc-4888-4aff-9a16-e2186cf71cdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:32:47 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-3337c5e6-cfb6-44b1-9c06-aa9a6e9b8e8a tempest-TaggedAttachmentsTest-43247108 None] Created volume successfully. Jun 02 00:32:57 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:32:57 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=7,cinder:SELECT=2,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:33:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] Acquiring lock "cinder-340b089f-4f5c-45f4-932e-a29772ff4b34-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:33:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] Lock "cinder-340b089f-4f5c-45f4-932e-a29772ff4b34-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:33:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] Acquiring lock "cinder-quobyte-340b089f-4f5c-45f4-932e-a29772ff4b34" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:33:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] Lock "cinder-quobyte-340b089f-4f5c-45f4-932e-a29772ff4b34" acquired by "delete_volume" :: waited 0.040s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:33:04 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43f577e-bfe9-4275-bbcb-34c9fb4e6b01]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:33:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-340b089f-4f5c-45f4-932e-a29772ff4b34 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:33:04 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-340b089f-4f5c-45f4-932e-a29772ff4b34 Jun 02 00:33:04 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:33:06 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Jun 02 00:33:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-340b089f-4f5c-45f4-932e-a29772ff4b34" returned: 0 in 1.630s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:33:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-340b089f-4f5c-45f4-932e-a29772ff4b34 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:33:06 devstack sudo[89299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-340b089f-4f5c-45f4-932e-a29772ff4b34 Jun 02 00:33:06 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:33:07 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root Jun 02 00:33:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-340b089f-4f5c-45f4-932e-a29772ff4b34" returned: 0 in 0.987s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:33:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] Lock "cinder-quobyte-340b089f-4f5c-45f4-932e-a29772ff4b34" released by "delete_volume" :: held 2.711s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:33:07 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] Created reservations ['bfb9bfe6-b1e2-4efb-add1-106c29f06f23', '386715da-0aa8-4e5b-81f0-66c67af38a2a', '4e870c23-ab67-49be-8cf3-82cb67cbed1f', '04676193-5058-48a2-8fa2-c00e30aaab10'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:33:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:33:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:33:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:33:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:33:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:33:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:33:07 devstack sudo[89312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:33:07 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:33:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-4de0a989-a167-47df-9505-d6912e369066 req-30e3076f-f7c6-4c41-b051-3446da0871da tempest-ServerActionsTestOtherA-544903603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:33:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-4de0a989-a167-47df-9505-d6912e369066 req-30e3076f-f7c6-4c41-b051-3446da0871da tempest-ServerActionsTestOtherA-544903603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:33:08 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[350b81f3-e4ae-4f4b-9c12-60ae0f5455eb]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:33:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-4de0a989-a167-47df-9505-d6912e369066 req-30e3076f-f7c6-4c41-b051-3446da0871da tempest-ServerActionsTestOtherA-544903603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:33:09 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d Jun 02 00:33:09 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:33:09 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root Jun 02 00:33:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.910s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:33:09 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:33:09 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] Deleted volume successfully. Jun 02 00:33:09 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d0af07bd-3f70-4351-a2a4-e197f57cd1fd tempest-ServerRescueNegativeTestJSON-1211436495 None] Lock "cinder-340b089f-4f5c-45f4-932e-a29772ff4b34-delete_volume" released by "delete_volume" :: held 5.175s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:33:10 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Jun 02 00:33:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-4de0a989-a167-47df-9505-d6912e369066 req-30e3076f-f7c6-4c41-b051-3446da0871da tempest-ServerActionsTestOtherA-544903603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d" returned: 0 in 1.736s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:33:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-4de0a989-a167-47df-9505-d6912e369066 req-30e3076f-f7c6-4c41-b051-3446da0871da tempest-ServerActionsTestOtherA-544903603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.815s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:33:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-4de0a989-a167-47df-9505-d6912e369066 req-30e3076f-f7c6-4c41-b051-3446da0871da tempest-ServerActionsTestOtherA-544903603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-3addbc58-2c25-4aab-8e74-cbd845e9397d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'deddf874-0573-4880-a996-6e70f0ee711c', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:33:11 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-4de0a989-a167-47df-9505-d6912e369066 req-30e3076f-f7c6-4c41-b051-3446da0871da tempest-ServerActionsTestOtherA-544903603 None] attachment_update completed successfully. Jun 02 00:33:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:33:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:33:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:33:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:33:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:33:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:33:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:33:15 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:33:15 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:33:17 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Jun 02 00:33:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 2.025s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:33:17 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:33:21 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=9,cinder:SELECT=10,cinder:INSERT=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:33:21 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:33:22 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-ff1b408b-416a-4fa9-b2e0-b61d02c6798a req-7a0dc6ee-97ec-48d9-afdd-1d861ddd8633 tempest-ServerActionsTestOtherA-544903603 None] Terminate volume connection completed successfully. Jun 02 00:33:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-ff1b408b-416a-4fa9-b2e0-b61d02c6798a req-7a0dc6ee-97ec-48d9-afdd-1d861ddd8633 tempest-ServerActionsTestOtherA-544903603 None] Deleting attachment deddf874-0573-4880-a996-6e70f0ee711c. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:33:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-ff1b408b-416a-4fa9-b2e0-b61d02c6798a req-7054c953-6d76-4bb8-8b00-6cd7364b1439 tempest-ServerActionsTestOtherA-544903603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:33:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-ff1b408b-416a-4fa9-b2e0-b61d02c6798a req-7054c953-6d76-4bb8-8b00-6cd7364b1439 tempest-ServerActionsTestOtherA-544903603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:33:24 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a1ccb8-7a49-41c2-abe4-4053292d4e2b]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:33:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-ff1b408b-416a-4fa9-b2e0-b61d02c6798a req-7054c953-6d76-4bb8-8b00-6cd7364b1439 tempest-ServerActionsTestOtherA-544903603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:33:24 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d Jun 02 00:33:24 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:33:25 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Jun 02 00:33:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-ff1b408b-416a-4fa9-b2e0-b61d02c6798a req-7054c953-6d76-4bb8-8b00-6cd7364b1439 tempest-ServerActionsTestOtherA-544903603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d" returned: 0 in 0.847s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:33:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-ff1b408b-416a-4fa9-b2e0-b61d02c6798a req-7054c953-6d76-4bb8-8b00-6cd7364b1439 tempest-ServerActionsTestOtherA-544903603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.863s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:33:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-ff1b408b-416a-4fa9-b2e0-b61d02c6798a req-7054c953-6d76-4bb8-8b00-6cd7364b1439 tempest-ServerActionsTestOtherA-544903603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-3addbc58-2c25-4aab-8e74-cbd845e9397d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba789282-9499-4ac9-8557-ebe439090a24', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:33:25 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-ff1b408b-416a-4fa9-b2e0-b61d02c6798a req-7054c953-6d76-4bb8-8b00-6cd7364b1439 tempest-ServerActionsTestOtherA-544903603 None] attachment_update completed successfully. Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Flow 'volume_create_manager' (ab7271c6-0cae-404b-a4da-889bca9e3207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f62f4b-7b74-4056-b71e-b7792564db17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f62f4b-7b74-4056-b71e-b7792564db17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-286355548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5470959e-e659-4047-909f-bfb176b81319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f50d5559c44ec08b4d15a6bcf750f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:33:27Z,use_quota=True,user_id='30d50c6e7f224a0f8dc9925f0a8bdba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e629b099-73d8-4c65-9294-f01f6fece6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e629b099-73d8-4c65-9294-f01f6fece6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9a135d-b5f7-4049-bd50-33875b27a548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9a135d-b5f7-4049-bd50-33875b27a548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5470959e-e659-4047-909f-bfb176b81319', 'volume_name': 'volume-5470959e-e659-4047-909f-bfb176b81319', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cfef29-1fa8-4d1d-96b8-88610d17a0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cfef29-1fa8-4d1d-96b8-88610d17a0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cf40c4-5cc6-473c-b7dd-7a54b823fae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:33:27 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Volume 5470959e-e659-4047-909f-bfb176b81319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5470959e-e659-4047-909f-bfb176b81319', 'volume_size': 1} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-286355548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5470959e-e659-4047-909f-bfb176b81319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f50d5559c44ec08b4d15a6bcf750f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:33:27Z,use_quota=True,user_id='30d50c6e7f224a0f8dc9925f0a8bdba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Creating volume 5470959e-e659-4047-909f-bfb176b81319 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:33:27 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5470959e-e659-4047-909f-bfb176b81319 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:33:27 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5470959e-e659-4047-909f-bfb176b81319 1073741824 Jun 02 00:33:27 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:33:27 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5470959e-e659-4047-909f-bfb176b81319 1073741824" returned: 0 in 0.768s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:33:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5470959e-e659-4047-909f-bfb176b81319 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:33:28 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5470959e-e659-4047-909f-bfb176b81319 Jun 02 00:33:28 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:33:28 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Jun 02 00:33:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5470959e-e659-4047-909f-bfb176b81319" returned: 0 in 0.684s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:33:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:33:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:33:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cf40c4-5cc6-473c-b7dd-7a54b823fae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5470959e-e659-4047-909f-bfb176b81319', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:33:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d43b228-8b1a-41aa-9b43-63f0ee9f40d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:33:28 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Volume volume-5470959e-e659-4047-909f-bfb176b81319 (5470959e-e659-4047-909f-bfb176b81319): created successfully Jun 02 00:33:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d43b228-8b1a-41aa-9b43-63f0ee9f40d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:33:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Flow 'volume_create_manager' (ab7271c6-0cae-404b-a4da-889bca9e3207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:33:28 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-2b688989-f3f4-4bda-8081-ae03dda61403 tempest-AttachVolumeTestJSON-475729283 None] Created volume successfully. Jun 02 00:33:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-82604337-0219-4989-9d9b-8850f95b4018 req-5e8ec43c-3a3b-4b6e-9d5a-e5c12397fe28 tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:33:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-82604337-0219-4989-9d9b-8850f95b4018 req-5e8ec43c-3a3b-4b6e-9d5a-e5c12397fe28 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:33:32 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[835856ed-c540-4b36-9c02-c4a77c4f0bae]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:33:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-82604337-0219-4989-9d9b-8850f95b4018 req-5e8ec43c-3a3b-4b6e-9d5a-e5c12397fe28 tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5470959e-e659-4047-909f-bfb176b81319 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:33:32 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5470959e-e659-4047-909f-bfb176b81319 Jun 02 00:33:32 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:33:33 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Jun 02 00:33:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-82604337-0219-4989-9d9b-8850f95b4018 req-5e8ec43c-3a3b-4b6e-9d5a-e5c12397fe28 tempest-AttachVolumeTestJSON-475729283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5470959e-e659-4047-909f-bfb176b81319" returned: 0 in 0.923s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:33:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-82604337-0219-4989-9d9b-8850f95b4018 req-5e8ec43c-3a3b-4b6e-9d5a-e5c12397fe28 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.949s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:33:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-82604337-0219-4989-9d9b-8850f95b4018 req-5e8ec43c-3a3b-4b6e-9d5a-e5c12397fe28 tempest-AttachVolumeTestJSON-475729283 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-5470959e-e659-4047-909f-bfb176b81319', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3de1111a-c250-4b5f-ab3f-dba232072d23', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:33:33 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-82604337-0219-4989-9d9b-8850f95b4018 req-5e8ec43c-3a3b-4b6e-9d5a-e5c12397fe28 tempest-AttachVolumeTestJSON-475729283 None] attachment_update completed successfully. Jun 02 00:33:43 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=14,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:33:43 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=14,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:33:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-26b57f67-b8a1-4616-859e-5d84ee7fafda req-e9910b68-5444-4bda-9bcf-be91fcec0242 tempest-TaggedAttachmentsTest-43247108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:33:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-26b57f67-b8a1-4616-859e-5d84ee7fafda req-e9910b68-5444-4bda-9bcf-be91fcec0242 tempest-TaggedAttachmentsTest-43247108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:33:57 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[590bdee4-9f30-4972-af40-366fd41c2ae9]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:33:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-26b57f67-b8a1-4616-859e-5d84ee7fafda req-e9910b68-5444-4bda-9bcf-be91fcec0242 tempest-TaggedAttachmentsTest-43247108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-246ed45d-1f5e-4e86-8538-2aad4250be6f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:33:57 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-246ed45d-1f5e-4e86-8538-2aad4250be6f Jun 02 00:33:57 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:33:58 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-d42250d3-0187-4b2d-af39-65c0af6f9d7a req-25ad098c-7232-4feb-bb26-eb6c48f59252 tempest-ServerActionsTestOtherA-544903603 None] Terminate volume connection completed successfully. Jun 02 00:33:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-d42250d3-0187-4b2d-af39-65c0af6f9d7a req-25ad098c-7232-4feb-bb26-eb6c48f59252 tempest-ServerActionsTestOtherA-544903603 None] Deleting attachment ba789282-9499-4ac9-8557-ebe439090a24. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:33:58 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Jun 02 00:33:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-26b57f67-b8a1-4616-859e-5d84ee7fafda req-e9910b68-5444-4bda-9bcf-be91fcec0242 tempest-TaggedAttachmentsTest-43247108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-246ed45d-1f5e-4e86-8538-2aad4250be6f" returned: 0 in 0.970s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:33:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-26b57f67-b8a1-4616-859e-5d84ee7fafda req-e9910b68-5444-4bda-9bcf-be91fcec0242 tempest-TaggedAttachmentsTest-43247108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.986s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:33:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-26b57f67-b8a1-4616-859e-5d84ee7fafda req-e9910b68-5444-4bda-9bcf-be91fcec0242 tempest-TaggedAttachmentsTest-43247108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-246ed45d-1f5e-4e86-8538-2aad4250be6f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '251fe5f9-60c8-4e60-8a8c-3678985d7347', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:33:58 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-26b57f67-b8a1-4616-859e-5d84ee7fafda req-e9910b68-5444-4bda-9bcf-be91fcec0242 tempest-TaggedAttachmentsTest-43247108 None] attachment_update completed successfully. Jun 02 00:34:06 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-deedf9bf-34ab-4354-8e34-e85391a8ad33 req-aae94161-df90-4344-b546-92f87e54a519 tempest-TaggedAttachmentsTest-43247108 None] Terminate volume connection completed successfully. Jun 02 00:34:06 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-deedf9bf-34ab-4354-8e34-e85391a8ad33 req-aae94161-df90-4344-b546-92f87e54a519 tempest-TaggedAttachmentsTest-43247108 None] Deleting attachment 251fe5f9-60c8-4e60-8a8c-3678985d7347. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:34:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] Acquiring lock "cinder-3addbc58-2c25-4aab-8e74-cbd845e9397d-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:34:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] Lock "cinder-3addbc58-2c25-4aab-8e74-cbd845e9397d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:34:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] Acquiring lock "cinder-quobyte-3addbc58-2c25-4aab-8e74-cbd845e9397d" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:34:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] Lock "cinder-quobyte-3addbc58-2c25-4aab-8e74-cbd845e9397d" acquired by "delete_volume" :: waited 0.111s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:34:10 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6158bc-5b08-420d-80d7-e198d19d8537]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:34:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:10 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d Jun 02 00:34:10 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:11 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d" returned: 0 in 0.995s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:11 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d Jun 02 00:34:11 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:12 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3addbc58-2c25-4aab-8e74-cbd845e9397d" returned: 0 in 0.618s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] Lock "cinder-quobyte-3addbc58-2c25-4aab-8e74-cbd845e9397d" released by "delete_volume" :: held 1.693s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:34:12 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] Created reservations ['7aca7438-6b76-4436-a8e4-11ba65aab90d', '7f03d7ad-fb53-43b8-8ecf-ed2a64475b5b', '137a3f67-663c-47fb-a694-421ba60896fd', '6eb74d65-a11f-4647-9dec-ce2ad456156d'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:34:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:34:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:34:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:34:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:34:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:34:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:12 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:34:12 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.741s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:12 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:34:12 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] Deleted volume successfully. Jun 02 00:34:12 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:13 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e556b336-339d-4fa9-a276-debc0375d954 tempest-ServerActionsTestOtherA-544903603 None] Lock "cinder-3addbc58-2c25-4aab-8e74-cbd845e9397d-delete_volume" released by "delete_volume" :: held 2.860s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:34:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:34:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:34:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:34:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:34:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:34:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:34:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:15 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:34:15 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:16 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.890s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:16 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:34:18 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-008450e2-6e5a-463f-8308-c37bbc3cf023 req-f170e218-9210-4fe0-832c-8c13fcb7eb0e tempest-AttachVolumeTestJSON-475729283 None] Terminate volume connection completed successfully. Jun 02 00:34:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-008450e2-6e5a-463f-8308-c37bbc3cf023 req-f170e218-9210-4fe0-832c-8c13fcb7eb0e tempest-AttachVolumeTestJSON-475729283 None] Deleting attachment 3de1111a-c250-4b5f-ab3f-dba232072d23. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:34:25 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] Acquiring lock "cinder-246ed45d-1f5e-4e86-8538-2aad4250be6f-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:34:25 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] Lock "cinder-246ed45d-1f5e-4e86-8538-2aad4250be6f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:34:25 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] Acquiring lock "cinder-quobyte-246ed45d-1f5e-4e86-8538-2aad4250be6f" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:34:25 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] Lock "cinder-quobyte-246ed45d-1f5e-4e86-8538-2aad4250be6f" acquired by "delete_volume" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:34:25 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96424cd-4f49-4a06-8031-1a17cc13fb59]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:34:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-246ed45d-1f5e-4e86-8538-2aad4250be6f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:26 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-246ed45d-1f5e-4e86-8538-2aad4250be6f Jun 02 00:34:26 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:26 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-246ed45d-1f5e-4e86-8538-2aad4250be6f" returned: 0 in 0.779s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-246ed45d-1f5e-4e86-8538-2aad4250be6f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:26 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-246ed45d-1f5e-4e86-8538-2aad4250be6f Jun 02 00:34:26 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:27 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-246ed45d-1f5e-4e86-8538-2aad4250be6f" returned: 0 in 0.669s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] Lock "cinder-quobyte-246ed45d-1f5e-4e86-8538-2aad4250be6f" released by "delete_volume" :: held 1.497s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] Created reservations ['ac447d2c-f6ca-45f3-8692-2f7a373b69a3', '6b4ab128-a48c-4742-94c2-dec70a72cb8d', '26dc9708-02d7-4fe0-9ddf-469c488bebe2', '077edd49-40f7-486d-a14e-d4fa386bf6f1'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:27 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:34:27 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Flow 'volume_create_manager' (cf7c23d6-9a4f-4026-8f5a-934290aaf5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76bc3ba-6020-40ae-99c4-b24fbcc498f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76bc3ba-6020-40ae-99c4-b24fbcc498f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-728051959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6793028c-63f7-4eca-a6ac-0ed2846c9a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa3be2c9b44f3abb73a4974ca4b7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:34:28Z,use_quota=True,user_id='36cff72b287c40c4a0c74a597658e506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513ff17a-1c79-43ef-b75f-80232fe87c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513ff17a-1c79-43ef-b75f-80232fe87c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ff10d6-a30f-493d-8210-6c350074283b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ff10d6-a30f-493d-8210-6c350074283b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6793028c-63f7-4eca-a6ac-0ed2846c9a13', 'volume_name': 'volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145da625-dfcc-4ffe-acd4-8d6f7adad2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145da625-dfcc-4ffe-acd4-8d6f7adad2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257a0a06-f408-4827-ad38-1f162801a7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:34:27 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Volume 6793028c-63f7-4eca-a6ac-0ed2846c9a13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13', 'volume_size': 1} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-728051959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6793028c-63f7-4eca-a6ac-0ed2846c9a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa3be2c9b44f3abb73a4974ca4b7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:34:28Z,use_quota=True,user_id='36cff72b287c40c4a0c74a597658e506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Creating volume 6793028c-63f7-4eca-a6ac-0ed2846c9a13 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:34:27 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:34:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:27 devstack sudo[91192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13 1073741824 Jun 02 00:34:27 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:28 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.723s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:28 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:34:28 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] Deleted volume successfully. Jun 02 00:34:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02bfa54d-f05f-42a6-9758-ecd86e122dc1 tempest-TaggedAttachmentsTest-43247108 None] Lock "cinder-246ed45d-1f5e-4e86-8538-2aad4250be6f-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:34:28 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13 1073741824" returned: 0 in 0.965s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:28 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13 Jun 02 00:34:28 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:29 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13" returned: 0 in 0.773s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:29 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:34:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:34:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257a0a06-f408-4827-ad38-1f162801a7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:34:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef0181d-d5fd-4b46-b959-bcedc615c441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:34:29 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Volume volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13 (6793028c-63f7-4eca-a6ac-0ed2846c9a13): created successfully Jun 02 00:34:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef0181d-d5fd-4b46-b959-bcedc615c441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:34:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Flow 'volume_create_manager' (cf7c23d6-9a4f-4026-8f5a-934290aaf5e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:34:29 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-6113ea4a-bfe5-49f7-9b11-27bf14470ec7 tempest-AttachVolumeNegativeTest-77772747 None] Created volume successfully. Jun 02 00:34:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-485dcc7e-37db-4323-a2e5-0bc1e7ae1ad7 req-ae4f7c12-960c-4cdd-98d1-45015c59f1f2 tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:34:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-485dcc7e-37db-4323-a2e5-0bc1e7ae1ad7 req-ae4f7c12-960c-4cdd-98d1-45015c59f1f2 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:34:34 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2587e2b-c8ee-4c37-b5fe-743711a11f3e]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:34:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-485dcc7e-37db-4323-a2e5-0bc1e7ae1ad7 req-ae4f7c12-960c-4cdd-98d1-45015c59f1f2 tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:34 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13 Jun 02 00:34:34 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:35 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-485dcc7e-37db-4323-a2e5-0bc1e7ae1ad7 req-ae4f7c12-960c-4cdd-98d1-45015c59f1f2 tempest-AttachVolumeNegativeTest-77772747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13" returned: 0 in 1.245s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-485dcc7e-37db-4323-a2e5-0bc1e7ae1ad7 req-ae4f7c12-960c-4cdd-98d1-45015c59f1f2 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.270s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:34:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-485dcc7e-37db-4323-a2e5-0bc1e7ae1ad7 req-ae4f7c12-960c-4cdd-98d1-45015c59f1f2 tempest-AttachVolumeNegativeTest-77772747 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'abdbc2c4-fa4e-4ee2-ae1b-20b2fd6e9066', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:34:35 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-485dcc7e-37db-4323-a2e5-0bc1e7ae1ad7 req-ae4f7c12-960c-4cdd-98d1-45015c59f1f2 tempest-AttachVolumeNegativeTest-77772747 None] attachment_update completed successfully. Jun 02 00:34:42 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:34:42 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Flow 'volume_create_manager' (30309bd2-6698-4625-818a-f2a00c7140fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fda99b4-9f0f-4b6b-9039-a03a8e6e7db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fda99b4-9f0f-4b6b-9039-a03a8e6e7db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-187869626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea197ec-23c6-4d14-8742-17cf9da3e27a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c01af790744b4a90a9a87907222f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:34:43Z,use_quota=True,user_id='9f4345831ec24554878dd8ad0b2b257c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715efc9b-1965-4e45-8dba-b5fdc0c4f8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715efc9b-1965-4e45-8dba-b5fdc0c4f8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7abb7d-d81d-43c3-b0bf-9ef8decd0b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7abb7d-d81d-43c3-b0bf-9ef8decd0b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cea197ec-23c6-4d14-8742-17cf9da3e27a', 'volume_name': 'volume-cea197ec-23c6-4d14-8742-17cf9da3e27a', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b46b28e-3dae-4dbc-8c90-41bcdbff1858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b46b28e-3dae-4dbc-8c90-41bcdbff1858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52dcef5-4dc4-4ef3-aee1-cfd0e21563b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:34:43 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Volume cea197ec-23c6-4d14-8742-17cf9da3e27a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cea197ec-23c6-4d14-8742-17cf9da3e27a', 'volume_size': 1} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-187869626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea197ec-23c6-4d14-8742-17cf9da3e27a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c01af790744b4a90a9a87907222f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:34:43Z,use_quota=True,user_id='9f4345831ec24554878dd8ad0b2b257c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Creating volume cea197ec-23c6-4d14-8742-17cf9da3e27a {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:34:43 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:34:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:43 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a 1073741824 Jun 02 00:34:43 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:44 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a 1073741824" returned: 0 in 1.137s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:44 devstack sudo[91703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a Jun 02 00:34:44 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:44 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a" returned: 0 in 0.666s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:34:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:34:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52dcef5-4dc4-4ef3-aee1-cfd0e21563b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea197ec-23c6-4d14-8742-17cf9da3e27a', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:34:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95eaa5bd-346a-493f-94ac-fe42f77723d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:34:44 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Volume volume-cea197ec-23c6-4d14-8742-17cf9da3e27a (cea197ec-23c6-4d14-8742-17cf9da3e27a): created successfully Jun 02 00:34:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95eaa5bd-346a-493f-94ac-fe42f77723d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:34:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Flow 'volume_create_manager' (30309bd2-6698-4625-818a-f2a00c7140fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:34:45 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-58387468-7a9e-4436-8c0e-fa13e716d736 req-e5339c06-801c-4307-a9a2-65eeae079df9 tempest-VolumesSnapshotsTestJSON-364109537 None] Created volume successfully. Jun 02 00:34:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:34:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:34:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] Creating offline snapshot 0ef5f526-332a-4530-ab02-24806d7a2364 of volume cea197ec-23c6-4d14-8742-17cf9da3e27a {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:34:45 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[214daae2-a300-4680-967e-3dc29301eda4]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:34:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:45 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a Jun 02 00:34:45 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:46 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a" returned: 0 in 0.893s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:46 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364 1G Jun 02 00:34:46 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:47 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364 1G" returned: 0 in 0.770s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cea197ec-23c6-4d14-8742-17cf9da3e27a -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:47 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cea197ec-23c6-4d14-8742-17cf9da3e27a -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364 Jun 02 00:34:47 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:47 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cea197ec-23c6-4d14-8742-17cf9da3e27a -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364" returned: 0 in 0.637s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:47 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364 is being set with open permissions: ugo+rw Jun 02 00:34:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:47 devstack sudo[91725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364 Jun 02 00:34:47 devstack sudo[91725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:48 devstack sudo[91725]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364" returned: 0 in 0.641s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:48 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.info Jun 02 00:34:48 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:49 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.info" returned: 0 in 0.746s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:49 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.info is being set with open permissions: ugo+rw Jun 02 00:34:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:49 devstack sudo[91731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.info Jun 02 00:34:49 devstack sudo[91731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:49 devstack sudo[91731]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.info" returned: 0 in 0.618s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.434s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:34:50 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-779a72d9-32bf-4349-9474-25c9f74b627d req-43b34d0c-a036-46e5-8595-e4bd70ffce6f tempest-VolumesSnapshotsTestJSON-364109537 None] Create snapshot completed successfully Jun 02 00:34:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Acquiring lock "cinder-0ef5f526-332a-4530-ab02-24806d7a2364-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:34:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "cinder-0ef5f526-332a-4530-ab02-24806d7a2364-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:34:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Acquiring lock "cinder-quobyte-cea197ec-23c6-4d14-8742-17cf9da3e27a" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:34:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "cinder-quobyte-cea197ec-23c6-4d14-8742-17cf9da3e27a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:34:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Acquiring lock "cinder-quobyte-0ef5f526-332a-4530-ab02-24806d7a2364" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:34:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "cinder-quobyte-0ef5f526-332a-4530-ab02-24806d7a2364" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:34:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Deleting offline snapshot 0ef5f526-332a-4530-ab02-24806d7a2364 of volume cea197ec-23c6-4d14-8742-17cf9da3e27a {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:34:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] snapshot_file for this snap is: volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:34:50 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aed0de7-4279-4347-ad79-c16f5a465afd]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:34:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:50 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364 Jun 02 00:34:50 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:51 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364" returned: 0 in 0.797s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cea197ec-23c6-4d14-8742-17cf9da3e27a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:34:51 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf1e1a7-e0cf-47ca-b6fe-cdc7a4b6fe26]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:34:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:51 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a Jun 02 00:34:51 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:52 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a" returned: 0 in 0.947s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:52 devstack sudo[91766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364 Jun 02 00:34:52 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:53 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364" returned: 0 in 0.862s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:53 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364 Jun 02 00:34:53 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:53 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a.0ef5f526-332a-4530-ab02-24806d7a2364" returned: 0 in 0.630s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:53 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=34,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:34:53 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=32,cinder:UPDATE=29,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:34:53 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "cinder-quobyte-0ef5f526-332a-4530-ab02-24806d7a2364" released by "_delete_snapshot" :: held 3.366s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:34:53 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "cinder-quobyte-cea197ec-23c6-4d14-8742-17cf9da3e27a" released by "delete_snapshot" :: held 3.409s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:34:54 devstack cinder-volume[86910]: WARNING cinder.quota [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:34:54 devstack cinder-volume[86910]: DEBUG cinder.quota [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Created reservations ['c3e8ecd1-c1f3-4a86-9ebf-f450666ae1cf', 'dd5dccac-3126-4277-990a-4c6f87bcb81a', '2036a85f-27e3-42b0-a818-ec0583f416ce', 'e9926d21-d5ce-4797-818e-216e7c16ec15'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:34:54 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Delete snapshot completed successfully. Jun 02 00:34:54 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-de96fe52-35a4-40e0-a094-7858e71f7adf req-ff027585-12f8-4993-bf3b-30a3944ef0be tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "cinder-0ef5f526-332a-4530-ab02-24806d7a2364-delete_snapshot" released by "delete_snapshot" :: held 3.539s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:34:54 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] Acquiring lock "cinder-cea197ec-23c6-4d14-8742-17cf9da3e27a-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:34:54 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "cinder-cea197ec-23c6-4d14-8742-17cf9da3e27a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:34:55 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] Acquiring lock "cinder-quobyte-cea197ec-23c6-4d14-8742-17cf9da3e27a" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:34:55 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "cinder-quobyte-cea197ec-23c6-4d14-8742-17cf9da3e27a" acquired by "delete_volume" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:34:55 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34f1206-9e58-47b1-a645-556c3e45d4f9]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:34:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:55 devstack sudo[91793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a Jun 02 00:34:55 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:56 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a" returned: 0 in 1.081s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:56 devstack sudo[91861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a Jun 02 00:34:56 devstack sudo[91861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:56 devstack sudo[91861]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cea197ec-23c6-4d14-8742-17cf9da3e27a" returned: 0 in 0.695s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "cinder-quobyte-cea197ec-23c6-4d14-8742-17cf9da3e27a" released by "delete_volume" :: held 1.832s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:34:56 devstack cinder-volume[86910]: DEBUG cinder.quota [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] Created reservations ['b834fb63-44d8-4fb5-a4a9-a48ffa9def99', '45bcd90f-4067-4928-9f00-c9a1c9c13070', 'a3ec19f5-6ff7-4391-9f20-0412251f2d2f', '04e4380f-ad6a-4c0d-a2bd-73534fa8c18d'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:34:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:34:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:34:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:34:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:34:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:34:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:34:57 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:34:57 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:34:58 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Jun 02 00:34:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.147s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:34:58 devstack cinder-volume[86910]: DEBUG cinder.manager [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:34:58 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] Deleted volume successfully. Jun 02 00:34:58 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-99626765-c982-4228-b1cc-0373d27d033c req-305b3b8e-9f74-4645-b771-d63065a0e166 tempest-VolumesSnapshotsTestJSON-364109537 None] Lock "cinder-cea197ec-23c6-4d14-8742-17cf9da3e27a-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:35:06 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=9,cinder:INSERT=5,cinder:UPDATE=12 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:35:08 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=10,cinder:INSERT=3,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:35:11 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-1b1840ba-7764-411f-baab-dee5d27638be tempest-GroupSnapshotsTest-2001499756 None] Group tempest-GroupSnapshotsTest-Group-2136702675: creating Jun 02 00:35:11 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-1b1840ba-7764-411f-baab-dee5d27638be tempest-GroupSnapshotsTest-2001499756 None] Group tempest-GroupSnapshotsTest-Group-2136702675: created successfully Jun 02 00:35:11 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-1b1840ba-7764-411f-baab-dee5d27638be tempest-GroupSnapshotsTest-2001499756 None] Create group completed successfully. Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Flow 'volume_create_manager' (1d792a6c-ed01-4767-8516-cf612f77d99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94cb63f3-c7fc-4a34-b45d-aa5970c3c410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94cb63f3-c7fc-4a34-b45d-aa5970c3c410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1228101747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6baa2e32-08a8-4b88-a803-358a2db8ae5e,host='devstack@QuobyteHD#QuobyteHD',id=60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857f6466f3e8446093144db540414a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:35:14Z,use_quota=True,user_id='c0af2dcb1fc8492fb099268a8ce388dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69c48325-4200-4e66-aa0a-063543c67a09),volume_type_id=69c48325-4200-4e66-aa0a-063543c67a09)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a33eb6-7c9c-4670-b333-dafc79aa8bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a33eb6-7c9c-4670-b333-dafc79aa8bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1f11ab-a81b-4c01-8295-3e6cd2248fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1f11ab-a81b-4c01-8295-3e6cd2248fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5', 'volume_name': 'volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afc4b5b-7dc3-4016-ad09-49c23acf77bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afc4b5b-7dc3-4016-ad09-49c23acf77bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f09b22-91dc-4ab2-887b-49f2a64c2eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:13 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Volume 60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5', 'volume_size': 1} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6baa2e32-08a8-4b88-a803-358a2db8ae5e,created_at=2026-06-01T22:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1228101747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6baa2e32-08a8-4b88-a803-358a2db8ae5e,host='devstack@QuobyteHD#QuobyteHD',id=60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857f6466f3e8446093144db540414a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:35:14Z,use_quota=True,user_id='c0af2dcb1fc8492fb099268a8ce388dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69c48325-4200-4e66-aa0a-063543c67a09),volume_type_id=69c48325-4200-4e66-aa0a-063543c67a09)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Creating volume 60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:35:13 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:35:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:13 devstack sudo[92061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 1073741824 Jun 02 00:35:13 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:14 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 1073741824" returned: 0 in 1.196s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:15 devstack sudo[92093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 Jun 02 00:35:15 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:35:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:35:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:35:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:15 devstack sudo[92096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:35:15 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:15 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5" returned: 0 in 0.746s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:35:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f09b22-91dc-4ab2-887b-49f2a64c2eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (679f145d-43b9-4fdc-8ac4-c7ea71c65d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:15 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Volume volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 (60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5): created successfully Jun 02 00:35:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (679f145d-43b9-4fdc-8ac4-c7ea71c65d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Flow 'volume_create_manager' (1d792a6c-ed01-4767-8516-cf612f77d99f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:35:15 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f2b07074-8de8-4b92-bc5e-0ce6f6e128f0 tempest-GroupSnapshotsTest-2001499756 None] Created volume successfully. Jun 02 00:35:15 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.772s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:15 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:35:17 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] GroupSnapshot 7562545b-1d6c-4f54-a135-4f3c0459b682: creating. Jun 02 00:35:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] Group snapshot 7562545b-1d6c-4f54-a135-4f3c0459b682: creating. {{(pid=86910) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 02 00:35:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:17 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] Creating offline snapshot 991548b3-5b9a-4f8b-894e-53769f9e2fa3 of volume 60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:35:17 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce98cc5-7308-4595-a01a-293be0b6762a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:35:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:17 devstack sudo[92104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 Jun 02 00:35:17 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:18 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5" returned: 0 in 0.841s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:18 devstack sudo[92148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3 1G Jun 02 00:35:18 devstack sudo[92148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:19 devstack sudo[92148]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3 1G" returned: 0 in 1.219s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:19 devstack sudo[92190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3 Jun 02 00:35:19 devstack sudo[92190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:20 devstack sudo[92190]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3" returned: 0 in 0.847s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:20 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3 is being set with open permissions: ugo+rw: NotImplementedError Jun 02 00:35:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:20 devstack sudo[92198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3 Jun 02 00:35:20 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:21 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3" returned: 0 in 0.758s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:21 devstack sudo[92201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.info Jun 02 00:35:21 devstack sudo[92201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:21 devstack sudo[92201]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.info" returned: 0 in 0.870s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:21 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 00:35:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:21 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.info Jun 02 00:35:21 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:22 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.info" returned: 0 in 0.723s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.387s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:22 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-33ce5b6c-53f2-4aa9-8ea4-8bc450d71138 tempest-GroupSnapshotsTest-2001499756 None] group_snapshot 7562545b-1d6c-4f54-a135-4f3c0459b682: created successfully Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "cinder-quobyte-991548b3-5b9a-4f8b-894e-53769f9e2fa3-bc18799c-fe74-44ba-b89c-41d0c14d8faf" by "_create_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-991548b3-5b9a-4f8b-894e-53769f9e2fa3-bc18799c-fe74-44ba-b89c-41d0c14d8faf" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Creating volume bc18799c-fe74-44ba-b89c-41d0c14d8faf from snapshot 991548b3-5b9a-4f8b-894e-53769f9e2fa3 {{(pid=86910) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "cinder-quobyte-bc18799c-fe74-44ba-b89c-41d0c14d8faf" by "_copy_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-bc18799c-fe74-44ba-b89c-41d0c14d8faf" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] snapshot: 991548b3-5b9a-4f8b-894e-53769f9e2fa3, volume: bc18799c-fe74-44ba-b89c-41d0c14d8faf, {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c07057-6fc1-4693-b8a1-000803948c74]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:35:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:25 devstack sudo[92258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3 Jun 02 00:35:25 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:26 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3" returned: 0 in 0.783s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:35:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 00:35:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Creating direct copy from snapshot {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 00:35:26 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5736b56e-fbb5-41be-b60b-83c662824c33]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:35:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:26 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 Jun 02 00:35:26 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:26 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5" returned: 0 in 0.767s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:26 devstack cinder-volume[86910]: DEBUG cinder.utils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Path /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bc18799c-fe74-44ba-b89c-41d0c14d8faf not found in is_blk_device check {{(pid=86910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 00:35:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bc18799c-fe74-44ba-b89c-41d0c14d8faf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:26 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bc18799c-fe74-44ba-b89c-41d0c14d8faf Jun 02 00:35:26 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bc18799c-fe74-44ba-b89c-41d0c14d8faf" returned: 0 in 8.157s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:35 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f41fda1-93e6-43f7-aa1f-190575d57a43]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:35:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:35 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=11,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:35:35 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=6,cinder:SELECT=13 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:35:35 devstack sudo[92437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 Jun 02 00:35:35 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:35:35 devstack sudo[92437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Flow 'volume_create_manager' (d2b6df6a-80e7-499f-a561-fe1292b063f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:35:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90f36ed-76d9-4457-9509-b17e78a930af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90f36ed-76d9-4457-9509-b17e78a930af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1891614087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8765cbe-8427-4b70-99bf-9fa65894c59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0005c349bf114ec3b86e2d23f66e9567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:35:35Z,use_quota=True,user_id='1cb580ecd58142c6b00e148a9958933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8e749d-b4b8-4287-bdc8-459acd7487ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8e749d-b4b8-4287-bdc8-459acd7487ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c285299-8b70-4424-955a-a62832696ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c285299-8b70-4424-955a-a62832696ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8765cbe-8427-4b70-99bf-9fa65894c59b', 'volume_name': 'volume-c8765cbe-8427-4b70-99bf-9fa65894c59b', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab5902c-1efe-434f-aab4-6e78c74dc2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab5902c-1efe-434f-aab4-6e78c74dc2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a446a514-f439-4d68-9c33-fc682f579a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:35 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Volume c8765cbe-8427-4b70-99bf-9fa65894c59b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8765cbe-8427-4b70-99bf-9fa65894c59b', 'volume_size': 1} Jun 02 00:35:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:36 devstack sudo[92437]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5" returned: 0 in 1.214s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:36 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Image conversion details: src /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5, size 1024.00 MB, duration 8.16 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bc18799c-fe74-44ba-b89c-41d0c14d8faf {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:35:36 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Converted 1024.00 MB image at 125.48 MB/s Jun 02 00:35:36 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bc18799c-fe74-44ba-b89c-41d0c14d8faf is being set with open permissions: ugo+rw: NotImplementedError Jun 02 00:35:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bc18799c-fe74-44ba-b89c-41d0c14d8faf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:36 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bc18799c-fe74-44ba-b89c-41d0c14d8faf Jun 02 00:35:36 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:37 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bc18799c-fe74-44ba-b89c-41d0c14d8faf" returned: 0 in 0.771s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-bc18799c-fe74-44ba-b89c-41d0c14d8faf" released by "_copy_volume_from_snapshot" :: held 11.860s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:35:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-991548b3-5b9a-4f8b-894e-53769f9e2fa3-bc18799c-fe74-44ba-b89c-41d0c14d8faf" released by "_create_volume_from_snapshot" :: held 11.910s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:35:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.958s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.565s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1891614087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8765cbe-8427-4b70-99bf-9fa65894c59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0005c349bf114ec3b86e2d23f66e9567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:35:35Z,use_quota=True,user_id='1cb580ecd58142c6b00e148a9958933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:35:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Creating volume c8765cbe-8427-4b70-99bf-9fa65894c59b {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:35:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:35:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:35:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:35:37 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:35:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c8765cbe-8427-4b70-99bf-9fa65894c59b 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:37 devstack sudo[92450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c8765cbe-8427-4b70-99bf-9fa65894c59b 1073741824 Jun 02 00:35:37 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:37 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-7d38d054-786f-449e-b37e-bceb79464871 tempest-GroupSnapshotsTest-2001499756 None] Create group from source-snapshot-7562545b-1d6c-4f54-a135-4f3c0459b682 completed successfully. Jun 02 00:35:37 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c8765cbe-8427-4b70-99bf-9fa65894c59b 1073741824" returned: 0 in 0.820s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c8765cbe-8427-4b70-99bf-9fa65894c59b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:37 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c8765cbe-8427-4b70-99bf-9fa65894c59b Jun 02 00:35:37 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "cinder-quobyte-bc18799c-fe74-44ba-b89c-41d0c14d8faf" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:35:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-bc18799c-fe74-44ba-b89c-41d0c14d8faf" acquired by "delete_volume" :: waited 0.032s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:35:38 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7e6191-028a-4241-96fa-9c52adb5b561]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:35:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bc18799c-fe74-44ba-b89c-41d0c14d8faf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:38 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bc18799c-fe74-44ba-b89c-41d0c14d8faf Jun 02 00:35:38 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:38 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c8765cbe-8427-4b70-99bf-9fa65894c59b" returned: 0 in 0.710s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:38 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:35:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:38 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a446a514-f439-4d68-9c33-fc682f579a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8765cbe-8427-4b70-99bf-9fa65894c59b', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:38 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54da3c1-49f8-4b44-86ce-6e611d552bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:38 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Volume volume-c8765cbe-8427-4b70-99bf-9fa65894c59b (c8765cbe-8427-4b70-99bf-9fa65894c59b): created successfully Jun 02 00:35:38 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54da3c1-49f8-4b44-86ce-6e611d552bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:38 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Flow 'volume_create_manager' (d2b6df6a-80e7-499f-a561-fe1292b063f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:35:38 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-8fbd59c9-5ed0-4f62-8350-d0d89dab28a8 tempest-ServersNegativeTestJSON-1258283445 None] Created volume successfully. Jun 02 00:35:38 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bc18799c-fe74-44ba-b89c-41d0c14d8faf" returned: 0 in 0.794s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bc18799c-fe74-44ba-b89c-41d0c14d8faf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:38 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bc18799c-fe74-44ba-b89c-41d0c14d8faf Jun 02 00:35:38 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:39 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bc18799c-fe74-44ba-b89c-41d0c14d8faf" returned: 0 in 0.746s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-bc18799c-fe74-44ba-b89c-41d0c14d8faf" released by "delete_volume" :: held 1.609s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:35:39 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] Created reservations ['5ed229de-1c1d-4e2d-82b7-1bb0ac16aad3'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:35:39 devstack cinder-volume[86910]: WARNING cinder.quota [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1287710444 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1287710444, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:35:39 devstack cinder-volume[86910]: WARNING cinder.quota [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1287710444 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1287710444, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:35:39 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] Created reservations ['6c748c6a-b327-468a-8055-90dc923a41d5', '10134ab5-e377-4d68-9ed3-5b6c01396b65', '299c0329-ab90-4b96-ba99-90b83f6fac74', '9cb97094-c47d-46b7-afaf-ab5f50c1c625'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:35:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:35:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:35:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:40 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:35:40 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:40 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] group_snapshot 7562545b-1d6c-4f54-a135-4f3c0459b682: deleting Jun 02 00:35:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] group_snapshot 7562545b-1d6c-4f54-a135-4f3c0459b682: deleting {{(pid=86910) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 02 00:35:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "cinder-quobyte-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:35:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:35:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "cinder-quobyte-991548b3-5b9a-4f8b-894e-53769f9e2fa3" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:35:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-991548b3-5b9a-4f8b-894e-53769f9e2fa3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:35:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] Deleting offline snapshot 991548b3-5b9a-4f8b-894e-53769f9e2fa3 of volume 60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:35:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] snapshot_file for this snap is: volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:35:40 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b199d30-2373-4f14-b8d8-59be060ac8d8]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:35:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:40 devstack sudo[92469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3 Jun 02 00:35:40 devstack sudo[92469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:40 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.925s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:40 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:35:41 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-2606aedb-748b-4d53-86ef-749e0c51cbca tempest-GroupSnapshotsTest-2001499756 None] Delete group completed successfully. Jun 02 00:35:41 devstack sudo[92469]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3" returned: 0 in 0.879s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[83112c33-84cb-413c-847a-7ab658689c6b]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Flow 'volume_create_manager' (ad52d0bd-d1df-41ec-9d28-fe66419647d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2eee50-13c2-4468-818c-e13711940202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2eee50-13c2-4468-818c-e13711940202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1996151963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d80517-2208-4f67-9eba-395c3dd1bfbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0005c349bf114ec3b86e2d23f66e9567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:35:42Z,use_quota=True,user_id='1cb580ecd58142c6b00e148a9958933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13c44a0-9148-4c12-a873-8786aadb781f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13c44a0-9148-4c12-a873-8786aadb781f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51827d1b-9dad-4a5c-a8f9-7b79c8bbddee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51827d1b-9dad-4a5c-a8f9-7b79c8bbddee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59d80517-2208-4f67-9eba-395c3dd1bfbb', 'volume_name': 'volume-59d80517-2208-4f67-9eba-395c3dd1bfbb', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da112e6-571a-4fb1-8b5e-e2bd5d2ab522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da112e6-571a-4fb1-8b5e-e2bd5d2ab522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6f4848-526e-47a1-84cc-e2ea5f7e3bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:41 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Volume 59d80517-2208-4f67-9eba-395c3dd1bfbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59d80517-2208-4f67-9eba-395c3dd1bfbb', 'volume_size': 1} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1996151963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d80517-2208-4f67-9eba-395c3dd1bfbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0005c349bf114ec3b86e2d23f66e9567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:35:42Z,use_quota=True,user_id='1cb580ecd58142c6b00e148a9958933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Creating volume 59d80517-2208-4f67-9eba-395c3dd1bfbb {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:35:41 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-59d80517-2208-4f67-9eba-395c3dd1bfbb 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:41 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 Jun 02 00:35:41 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:41 devstack sudo[92478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-59d80517-2208-4f67-9eba-395c3dd1bfbb 1073741824 Jun 02 00:35:41 devstack sudo[92478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:41 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-2c4dc16a-d172-4585-babf-454603d61be8 req-78c95adb-b60a-47c4-b2ac-ef0c69e10746 tempest-AttachVolumeNegativeTest-77772747 None] Terminate volume connection completed successfully. Jun 02 00:35:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-2c4dc16a-d172-4585-babf-454603d61be8 req-78c95adb-b60a-47c4-b2ac-ef0c69e10746 tempest-AttachVolumeNegativeTest-77772747 None] Deleting attachment abdbc2c4-fa4e-4ee2-ae1b-20b2fd6e9066. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:35:42 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5" returned: 0 in 0.858s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:42 devstack sudo[92493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3 Jun 02 00:35:42 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:42 devstack sudo[92478]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-59d80517-2208-4f67-9eba-395c3dd1bfbb 1073741824" returned: 0 in 0.900s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-59d80517-2208-4f67-9eba-395c3dd1bfbb {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:42 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-59d80517-2208-4f67-9eba-395c3dd1bfbb Jun 02 00:35:42 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:43 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3" returned: 0 in 0.899s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:43 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-59d80517-2208-4f67-9eba-395c3dd1bfbb" returned: 0 in 0.707s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:35:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6f4848-526e-47a1-84cc-e2ea5f7e3bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d80517-2208-4f67-9eba-395c3dd1bfbb', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fca9765-4bbb-4562-a204-9a8278188571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:43 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3 Jun 02 00:35:43 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:43 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Volume volume-59d80517-2208-4f67-9eba-395c3dd1bfbb (59d80517-2208-4f67-9eba-395c3dd1bfbb): created successfully Jun 02 00:35:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fca9765-4bbb-4562-a204-9a8278188571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Flow 'volume_create_manager' (ad52d0bd-d1df-41ec-9d28-fe66419647d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:35:43 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-6b611593-2328-4f7e-83e4-d90b0161cd9a tempest-ServersNegativeTestJSON-1258283445 None] Created volume successfully. Jun 02 00:35:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] Acquiring lock "cinder-59d80517-2208-4f67-9eba-395c3dd1bfbb-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:35:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] Lock "cinder-59d80517-2208-4f67-9eba-395c3dd1bfbb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:35:44 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5.991548b3-5b9a-4f8b-894e-53769f9e2fa3" returned: 0 in 0.890s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-991548b3-5b9a-4f8b-894e-53769f9e2fa3" released by "_delete_snapshot" :: held 3.680s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:35:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] Acquiring lock "cinder-quobyte-59d80517-2208-4f67-9eba-395c3dd1bfbb" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:35:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5" released by "delete_snapshot" :: held 3.714s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:35:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] Lock "cinder-quobyte-59d80517-2208-4f67-9eba-395c3dd1bfbb" acquired by "delete_volume" :: waited 0.035s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:35:44 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[86458380-c426-4937-aff1-0e322de0c73f]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:35:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-59d80517-2208-4f67-9eba-395c3dd1bfbb {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:44 devstack cinder-volume[86910]: WARNING cinder.quota [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1287710444 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1287710444, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:35:44 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] Created reservations ['9f77f8a6-96ea-4601-a5ac-d50635d94258', 'eea418dc-4631-48b5-afc3-1ec4e577089f', '0e1e9803-fe38-4307-b997-598deb703f2b', 'c2854d35-949a-4dd4-87ed-2182a2547733'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:35:44 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-02851682-9619-4b9f-8061-b8e34fab9593 tempest-GroupSnapshotsTest-2001499756 None] group_snapshot 7562545b-1d6c-4f54-a135-4f3c0459b682: deleted successfully Jun 02 00:35:44 devstack sudo[92506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-59d80517-2208-4f67-9eba-395c3dd1bfbb Jun 02 00:35:44 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:45 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-59d80517-2208-4f67-9eba-395c3dd1bfbb" returned: 0 in 0.829s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-59d80517-2208-4f67-9eba-395c3dd1bfbb {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:45 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-59d80517-2208-4f67-9eba-395c3dd1bfbb Jun 02 00:35:45 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "cinder-quobyte-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:35:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5" acquired by "delete_volume" :: waited 0.063s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:35:45 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b2d1ce-fa6e-4604-8fff-51f2bfc1b041]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:35:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:45 devstack sudo[92566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 Jun 02 00:35:45 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:46 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-59d80517-2208-4f67-9eba-395c3dd1bfbb" returned: 0 in 0.864s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] Lock "cinder-quobyte-59d80517-2208-4f67-9eba-395c3dd1bfbb" released by "delete_volume" :: held 1.742s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] Created reservations ['6e5e3922-16ac-46eb-be41-45a1d6eee3d5', 'ea680b4d-6ef9-4fcc-ab20-be6a324fd72e', '5f351761-556f-4f66-89a9-f956bc238772', 'a39b73eb-14cd-4a97-98c5-2cc125bf1040'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:46 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:35:46 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:46 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5" returned: 0 in 0.830s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:46 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5 Jun 02 00:35:46 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] Acquiring lock "cinder-c8765cbe-8427-4b70-99bf-9fa65894c59b-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] Lock "cinder-c8765cbe-8427-4b70-99bf-9fa65894c59b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] Acquiring lock "cinder-quobyte-c8765cbe-8427-4b70-99bf-9fa65894c59b" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] Lock "cinder-quobyte-c8765cbe-8427-4b70-99bf-9fa65894c59b" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[714211ab-75a6-4a0b-8285-8e34f38324bd]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c8765cbe-8427-4b70-99bf-9fa65894c59b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:46 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.700s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:46 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:35:46 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] Deleted volume successfully. Jun 02 00:35:47 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c8765cbe-8427-4b70-99bf-9fa65894c59b Jun 02 00:35:47 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-03271838-54c2-463e-8cb7-05d32b62088a tempest-ServersNegativeTestJSON-1258283445 None] Lock "cinder-59d80517-2208-4f67-9eba-395c3dd1bfbb-delete_volume" released by "delete_volume" :: held 2.768s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:35:47 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5" returned: 0 in 0.773s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-60a5848d-6e2c-4a8b-ad44-b5b9bfc8e5c5" released by "delete_volume" :: held 1.688s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:35:47 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] Created reservations ['cb38cec5-39c7-46ac-bae2-1bec4c70f906'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:35:47 devstack cinder-volume[86910]: WARNING cinder.db.sqlalchemy.api [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1287710444'] Jun 02 00:35:47 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] Created reservations ['dea9f9a5-9b63-4de2-b866-6bdf7307065b', '80d345a5-aff4-4b37-9a30-deed8428ed7d', '6d77fdd3-7c27-4e59-a8bc-450c59258121', '1e99efe1-1d04-43df-a4b7-a4a8fcf0fd46'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:35:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:35:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:35:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:47 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:35:47 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:47 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c8765cbe-8427-4b70-99bf-9fa65894c59b" returned: 0 in 0.909s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c8765cbe-8427-4b70-99bf-9fa65894c59b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:47 devstack sudo[92590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c8765cbe-8427-4b70-99bf-9fa65894c59b Jun 02 00:35:47 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:48 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.656s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:48 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:35:48 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-577d42df-fdbc-4c5f-a0f1-d88bc2c89ac4 tempest-GroupSnapshotsTest-2001499756 None] Delete group completed successfully. Jun 02 00:35:48 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e3e91362-45a6-4faa-865c-f04cf437b7e2 tempest-GroupSnapshotsTest-2001499756 None] Group tempest-GroupSnapshotsTest-Group-1464830569: creating Jun 02 00:35:48 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e3e91362-45a6-4faa-865c-f04cf437b7e2 tempest-GroupSnapshotsTest-2001499756 None] Group tempest-GroupSnapshotsTest-Group-1464830569: created successfully Jun 02 00:35:48 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e3e91362-45a6-4faa-865c-f04cf437b7e2 tempest-GroupSnapshotsTest-2001499756 None] Create group completed successfully. Jun 02 00:35:48 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c8765cbe-8427-4b70-99bf-9fa65894c59b" returned: 0 in 0.707s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:48 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] Lock "cinder-quobyte-c8765cbe-8427-4b70-99bf-9fa65894c59b" released by "delete_volume" :: held 1.669s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:35:48 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] Created reservations ['13a599dc-b561-497b-9e19-3f9b84577b4c', '1b6a6796-f415-40a7-b7aa-192dc501d512', '61a6df08-b625-47e9-8ea4-307663252d2c', '7ee289f4-1341-434d-bc0f-49bd699d0d9c'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:35:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:48 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:35:48 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:35:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:48 devstack sudo[92594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:35:48 devstack sudo[92594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:49 devstack sudo[92594]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.616s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:35:49 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] Deleted volume successfully. Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5b46e38f-f9b1-45d4-ba25-7c10a382f0f0 tempest-ServersNegativeTestJSON-1258283445 None] Lock "cinder-c8765cbe-8427-4b70-99bf-9fa65894c59b-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Flow 'volume_create_manager' (db84990c-09d9-4813-b829-c188f2990345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb38e21-cd5a-4b9a-834b-4131df93aef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb38e21-cd5a-4b9a-834b-4131df93aef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-557392241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c890c652-3f55-4b11-89c3-3a596346fafb,host='devstack@QuobyteHD#QuobyteHD',id=ed440afd-3c64-4d95-bae6-77cc9f3c9023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857f6466f3e8446093144db540414a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:35:50Z,use_quota=True,user_id='c0af2dcb1fc8492fb099268a8ce388dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a125e6d1-1d4d-489d-bbfc-dec568a2f251),volume_type_id=a125e6d1-1d4d-489d-bbfc-dec568a2f251)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7644c8ac-d5f9-46de-91ef-4d7c6234f0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7644c8ac-d5f9-46de-91ef-4d7c6234f0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82adf787-0bc7-4af5-ac2e-663cba0d18c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82adf787-0bc7-4af5-ac2e-663cba0d18c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed440afd-3c64-4d95-bae6-77cc9f3c9023', 'volume_name': 'volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8adfd70e-5d1c-434a-8cc1-0b6d7c248e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8adfd70e-5d1c-434a-8cc1-0b6d7c248e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac19d46-b610-4539-a0e3-2ad3d84953b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:49 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Volume ed440afd-3c64-4d95-bae6-77cc9f3c9023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023', 'volume_size': 1} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c890c652-3f55-4b11-89c3-3a596346fafb,created_at=2026-06-01T22:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-557392241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c890c652-3f55-4b11-89c3-3a596346fafb,host='devstack@QuobyteHD#QuobyteHD',id=ed440afd-3c64-4d95-bae6-77cc9f3c9023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857f6466f3e8446093144db540414a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:35:50Z,use_quota=True,user_id='c0af2dcb1fc8492fb099268a8ce388dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a125e6d1-1d4d-489d-bbfc-dec568a2f251),volume_type_id=a125e6d1-1d4d-489d-bbfc-dec568a2f251)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Creating volume ed440afd-3c64-4d95-bae6-77cc9f3c9023 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:35:49 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:35:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:49 devstack sudo[92597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023 1073741824 Jun 02 00:35:49 devstack sudo[92597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:50 devstack sudo[92597]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023 1073741824" returned: 0 in 0.949s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:50 devstack sudo[92641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023 Jun 02 00:35:50 devstack sudo[92641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:51 devstack sudo[92641]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023" returned: 0 in 0.657s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:35:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac19d46-b610-4539-a0e3-2ad3d84953b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3094695-d7b3-4329-a3f0-f01f2ace3318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:51 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Volume volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023 (ed440afd-3c64-4d95-bae6-77cc9f3c9023): created successfully Jun 02 00:35:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3094695-d7b3-4329-a3f0-f01f2ace3318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Flow 'volume_create_manager' (db84990c-09d9-4813-b829-c188f2990345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:35:51 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-b7774f4e-a510-4cfd-a874-f5751756ba14 tempest-GroupSnapshotsTest-2001499756 None] Created volume successfully. Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Flow 'volume_create_manager' (60bed4da-8152-4437-b4b0-8cce6cb7f467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96c38f3-7723-4dae-8afa-f82de20baef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96c38f3-7723-4dae-8afa-f82de20baef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-708479227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c890c652-3f55-4b11-89c3-3a596346fafb,host='devstack@QuobyteHD#QuobyteHD',id=d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857f6466f3e8446093144db540414a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:35:53Z,use_quota=True,user_id='c0af2dcb1fc8492fb099268a8ce388dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a125e6d1-1d4d-489d-bbfc-dec568a2f251),volume_type_id=a125e6d1-1d4d-489d-bbfc-dec568a2f251)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1ff8dd-994c-4ab6-9cd9-0e7bc96800cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1ff8dd-994c-4ab6-9cd9-0e7bc96800cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa59ef0-ecf0-473b-b0d0-b104c3dcccfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa59ef0-ecf0-473b-b0d0-b104c3dcccfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42', 'volume_name': 'volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d510c98-dcb1-4bb5-b6d7-60dfcbe083e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d510c98-dcb1-4bb5-b6d7-60dfcbe083e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6434fb3f-abb1-4ef6-abd6-57b8887a50fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:52 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Volume d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42', 'volume_size': 1} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c890c652-3f55-4b11-89c3-3a596346fafb,created_at=2026-06-01T22:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-708479227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c890c652-3f55-4b11-89c3-3a596346fafb,host='devstack@QuobyteHD#QuobyteHD',id=d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857f6466f3e8446093144db540414a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:35:53Z,use_quota=True,user_id='c0af2dcb1fc8492fb099268a8ce388dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a125e6d1-1d4d-489d-bbfc-dec568a2f251),volume_type_id=a125e6d1-1d4d-489d-bbfc-dec568a2f251)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Creating volume d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:35:52 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:35:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:52 devstack sudo[92646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 1073741824 Jun 02 00:35:52 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:53 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 1073741824" returned: 0 in 0.962s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:53 devstack sudo[92652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 Jun 02 00:35:53 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:54 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42" returned: 0 in 0.624s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:35:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6434fb3f-abb1-4ef6-abd6-57b8887a50fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76de0741-3680-47a3-aeb3-a54a17055c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:54 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Volume volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 (d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42): created successfully Jun 02 00:35:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76de0741-3680-47a3-aeb3-a54a17055c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Flow 'volume_create_manager' (60bed4da-8152-4437-b4b0-8cce6cb7f467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:35:54 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ba7c9408-0425-419b-baed-72f8523062f7 tempest-GroupSnapshotsTest-2001499756 None] Created volume successfully. Jun 02 00:35:55 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-23f98a0d-95b8-4c8c-a3c0-61cede4defbc tempest-GroupSnapshotsTest-2001499756 None] Update group completed successfully. Jun 02 00:35:56 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-2b524398-e281-4cdc-81c0-895df3f6d8c0 tempest-GroupSnapshotsTest-2001499756 None] Update group completed successfully. Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Flow 'volume_create_manager' (86b18aa4-2c49-4686-8ea6-6ad16d23b5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a9b1bf-d963-45fb-818c-be386b359dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a9b1bf-d963-45fb-818c-be386b359dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1336424414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82782284-4d6f-4b8e-89b5-a29c2e562e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f50d5559c44ec08b4d15a6bcf750f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:35:57Z,use_quota=True,user_id='30d50c6e7f224a0f8dc9925f0a8bdba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950dd326-6422-465a-ae3c-e94d2bb142a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950dd326-6422-465a-ae3c-e94d2bb142a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f5ee07-337c-48e4-b9f8-e5957954f605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f5ee07-337c-48e4-b9f8-e5957954f605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82782284-4d6f-4b8e-89b5-a29c2e562e5c', 'volume_name': 'volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681abaa9-3709-4570-be72-0e7159809a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681abaa9-3709-4570-be72-0e7159809a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4a9608-6bfe-4ba3-b091-022b60f3b1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:56 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Volume 82782284-4d6f-4b8e-89b5-a29c2e562e5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c', 'volume_size': 1} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1336424414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82782284-4d6f-4b8e-89b5-a29c2e562e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f50d5559c44ec08b4d15a6bcf750f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:35:57Z,use_quota=True,user_id='30d50c6e7f224a0f8dc9925f0a8bdba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Creating volume 82782284-4d6f-4b8e-89b5-a29c2e562e5c {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:35:56 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:35:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:56 devstack sudo[92660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c 1073741824 Jun 02 00:35:56 devstack sudo[92660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:57 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e94315f4-b8ad-4e98-908b-7c7a91ff47fe tempest-GroupSnapshotsTest-2001499756 None] Update group completed successfully. Jun 02 00:35:57 devstack sudo[92660]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c 1073741824" returned: 0 in 0.872s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:35:57 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c Jun 02 00:35:57 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:35:58 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Jun 02 00:35:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c" returned: 0 in 0.666s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:35:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:35:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:35:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4a9608-6bfe-4ba3-b091-022b60f3b1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad894af7-3333-486f-b032-eb7c7a73c13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:35:58 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Volume volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c (82782284-4d6f-4b8e-89b5-a29c2e562e5c): created successfully Jun 02 00:35:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad894af7-3333-486f-b032-eb7c7a73c13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:35:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Flow 'volume_create_manager' (86b18aa4-2c49-4686-8ea6-6ad16d23b5f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:35:58 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-3ffd99b4-9a5f-4b85-a20d-3dac1ca7bc61 tempest-AttachVolumeTestJSON-475729283 None] Created volume successfully. Jun 02 00:35:58 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-02cbd9ec-49f8-4ddd-9eb8-93d3c4761c74 tempest-GroupSnapshotsTest-2001499756 None] Update group completed successfully. Jun 02 00:36:00 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] GroupSnapshot 67ecf136-c3ae-4921-87c5-ce050e167922: creating. Jun 02 00:36:00 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Group snapshot 67ecf136-c3ae-4921-87c5-ce050e167922: creating. {{(pid=86910) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 02 00:36:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Creating offline snapshot 28eeed87-edf1-43a4-8b12-c7962c280357 of volume d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:36:00 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea46e62-cb6d-4c06-98c3-f0fce72a8e60]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:00 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 Jun 02 00:36:00 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:01 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42" returned: 0 in 0.811s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:01 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357 1G Jun 02 00:36:01 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-779918f5-7c82-4e86-a152-27e9e0ab850b req-8eb6314e-01f0-437e-8147-0b4863ee14a2 tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:02 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357 1G" returned: 0 in 1.435s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:02 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357 Jun 02 00:36:02 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:03 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357" returned: 0 in 0.817s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:03 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357 is being set with open permissions: ugo+rw: NotImplementedError Jun 02 00:36:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:03 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357 Jun 02 00:36:03 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:04 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357" returned: 0 in 0.709s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:04 devstack sudo[92727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.info Jun 02 00:36:04 devstack sudo[92727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:04 devstack sudo[92727]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.info" returned: 0 in 0.675s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:04 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 00:36:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:04 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.info Jun 02 00:36:04 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:05 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.info" returned: 0 in 0.615s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.187s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Creating offline snapshot f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061 of volume ed440afd-3c64-4d95-bae6-77cc9f3c9023 {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:36:05 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[081dffff-d7ed-4006-89a8-054a347e34f7]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:05 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023 Jun 02 00:36:05 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:06 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023" returned: 0 in 0.791s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:06 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061 1G Jun 02 00:36:06 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:07 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061 1G" returned: 0 in 0.948s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:07 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061 Jun 02 00:36:07 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:07 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061" returned: 0 in 0.694s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:07 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061 is being set with open permissions: ugo+rw: NotImplementedError Jun 02 00:36:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:07 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061 Jun 02 00:36:07 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:08 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061" returned: 0 in 0.696s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:08 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.info Jun 02 00:36:08 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:09 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.info" returned: 0 in 1.071s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:09 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 00:36:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:09 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.info Jun 02 00:36:09 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:10 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.info" returned: 0 in 0.874s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.231s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-779918f5-7c82-4e86-a152-27e9e0ab850b req-8eb6314e-01f0-437e-8147-0b4863ee14a2 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.435s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:10 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea07efc6-2d29-4620-801a-5d1bf37d14df]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-779918f5-7c82-4e86-a152-27e9e0ab850b req-8eb6314e-01f0-437e-8147-0b4863ee14a2 tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:10 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-34494732-d5b4-494f-bc51-791ede6ecf01 tempest-GroupSnapshotsTest-2001499756 None] group_snapshot 67ecf136-c3ae-4921-87c5-ce050e167922: created successfully Jun 02 00:36:10 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c Jun 02 00:36:10 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:11 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-779918f5-7c82-4e86-a152-27e9e0ab850b req-8eb6314e-01f0-437e-8147-0b4863ee14a2 tempest-AttachVolumeTestJSON-475729283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c" returned: 0 in 1.163s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-779918f5-7c82-4e86-a152-27e9e0ab850b req-8eb6314e-01f0-437e-8147-0b4863ee14a2 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.194s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-779918f5-7c82-4e86-a152-27e9e0ab850b req-8eb6314e-01f0-437e-8147-0b4863ee14a2 tempest-AttachVolumeTestJSON-475729283 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47ddac59-7cb2-4f66-95d0-d2286f6c7f4f', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:36:12 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-779918f5-7c82-4e86-a152-27e9e0ab850b req-8eb6314e-01f0-437e-8147-0b4863ee14a2 tempest-AttachVolumeTestJSON-475729283 None] attachment_update completed successfully. Jun 02 00:36:12 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] group_snapshot 67ecf136-c3ae-4921-87c5-ce050e167922: deleting Jun 02 00:36:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] group_snapshot 67ecf136-c3ae-4921-87c5-ce050e167922: deleting {{(pid=86910) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 02 00:36:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "cinder-quobyte-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:36:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:36:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "cinder-quobyte-28eeed87-edf1-43a4-8b12-c7962c280357" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:36:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-28eeed87-edf1-43a4-8b12-c7962c280357" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:36:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Deleting offline snapshot 28eeed87-edf1-43a4-8b12-c7962c280357 of volume d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:36:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] snapshot_file for this snap is: volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:36:12 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[415a880d-ce81-4a8f-956d-50d16dbc5204]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:12 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357 Jun 02 00:36:12 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:13 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357" returned: 0 in 0.986s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:36:13 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a81a36-b498-4ee3-bd0b-c1831a5c4767]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:13 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 Jun 02 00:36:13 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:14 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42" returned: 0 in 1.008s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:14 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357 Jun 02 00:36:14 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:36:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:36:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:36:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:15 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:36:15 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:15 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357" returned: 0 in 1.033s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:15 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357 Jun 02 00:36:15 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:16 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.119s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:16 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:36:16 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42.28eeed87-edf1-43a4-8b12-c7962c280357" returned: 0 in 0.841s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-28eeed87-edf1-43a4-8b12-c7962c280357" released by "_delete_snapshot" :: held 4.080s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:36:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42" released by "delete_snapshot" :: held 4.127s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:36:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "cinder-quobyte-ed440afd-3c64-4d95-bae6-77cc9f3c9023" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:36:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-ed440afd-3c64-4d95-bae6-77cc9f3c9023" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:36:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "cinder-quobyte-f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:36:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:36:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Deleting offline snapshot f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061 of volume ed440afd-3c64-4d95-bae6-77cc9f3c9023 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:36:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] snapshot_file for this snap is: volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:36:16 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad2abd0-4d6d-4282-92cc-96dd481a85e2]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:16 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061 Jun 02 00:36:16 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:17 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061" returned: 0 in 0.892s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:17 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:36:17 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c532b49-e413-45d2-b017-191093efc196]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:17 devstack sudo[93251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023 Jun 02 00:36:17 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Flow 'volume_create_manager' (4a18aa42-d818-4ce1-99b7-83b09cb670bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6527dcb6-7d6d-4b3b-9c5f-8d5365ea3cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6527dcb6-7d6d-4b3b-9c5f-8d5365ea3cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1496850020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=772798e3-a920-4c85-90e1-32d8da769dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f50d5559c44ec08b4d15a6bcf750f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:36:18Z,use_quota=True,user_id='30d50c6e7f224a0f8dc9925f0a8bdba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4d6151-fafa-4225-b81c-62605b5e8898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4d6151-fafa-4225-b81c-62605b5e8898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569333f1-5fe0-452f-8d50-0169fe24674c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569333f1-5fe0-452f-8d50-0169fe24674c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '772798e3-a920-4c85-90e1-32d8da769dee', 'volume_name': 'volume-772798e3-a920-4c85-90e1-32d8da769dee', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04391d4-1fee-4d64-bd4e-84d646d111d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04391d4-1fee-4d64-bd4e-84d646d111d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e50dc94-3c62-4186-bb2f-27e70349eec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:18 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Volume 772798e3-a920-4c85-90e1-32d8da769dee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-772798e3-a920-4c85-90e1-32d8da769dee', 'volume_size': 1} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1496850020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=772798e3-a920-4c85-90e1-32d8da769dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f50d5559c44ec08b4d15a6bcf750f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:36:18Z,use_quota=True,user_id='30d50c6e7f224a0f8dc9925f0a8bdba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Creating volume 772798e3-a920-4c85-90e1-32d8da769dee {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:36:18 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-772798e3-a920-4c85-90e1-32d8da769dee 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:18 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-772798e3-a920-4c85-90e1-32d8da769dee 1073741824 Jun 02 00:36:18 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:18 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023" returned: 0 in 1.125s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:18 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061 Jun 02 00:36:18 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:19 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-772798e3-a920-4c85-90e1-32d8da769dee 1073741824" returned: 0 in 0.948s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-772798e3-a920-4c85-90e1-32d8da769dee {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:19 devstack sudo[93301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-772798e3-a920-4c85-90e1-32d8da769dee Jun 02 00:36:19 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:19 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061" returned: 0 in 0.789s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:19 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061 Jun 02 00:36:19 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:19 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-772798e3-a920-4c85-90e1-32d8da769dee" returned: 0 in 0.627s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:36:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e50dc94-3c62-4186-bb2f-27e70349eec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-772798e3-a920-4c85-90e1-32d8da769dee', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3711f56c-b1c1-4224-9540-e6ecf173b59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:19 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Volume volume-772798e3-a920-4c85-90e1-32d8da769dee (772798e3-a920-4c85-90e1-32d8da769dee): created successfully Jun 02 00:36:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3711f56c-b1c1-4224-9540-e6ecf173b59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Flow 'volume_create_manager' (4a18aa42-d818-4ce1-99b7-83b09cb670bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:36:19 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-1788315b-f0fc-4d17-a95c-0027a16f7c87 tempest-AttachVolumeTestJSON-475729283 None] Created volume successfully. Jun 02 00:36:20 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023.f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061" returned: 0 in 0.690s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:20 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-f1cb7d07-f4ac-4d3b-a02c-a0e3f4fc9061" released by "_delete_snapshot" :: held 3.661s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:36:20 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-ed440afd-3c64-4d95-bae6-77cc9f3c9023" released by "delete_snapshot" :: held 3.683s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:36:20 devstack cinder-volume[86910]: WARNING cinder.quota [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2113841755 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2113841755, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:36:20 devstack cinder-volume[86910]: WARNING cinder.quota [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2113841755 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2113841755, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:36:20 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Created reservations ['316664ec-4865-485c-ae41-4bfd8aeef304', 'b605ffa7-7a48-4eca-a0f0-1fdaccbc7d0c', '8e3d2c1e-29c2-4dab-88b9-d6ef83bf6638', 'a23c44f1-f060-433b-a5ad-eccc2ae6819a'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:36:20 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] Created reservations ['ae5d4e35-a838-4df8-b524-035f4e3a4ee0', '0385bd1e-e845-4c58-b712-42a082c74c45', '25954944-99f5-46ab-9009-dc2fcc431f46', '9a8b9b85-59ad-4880-8c75-8212b767e8dd'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:36:20 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-fbb43b64-182d-46b7-b21b-1faae58f7483 tempest-GroupSnapshotsTest-2001499756 None] group_snapshot 67ecf136-c3ae-4921-87c5-ce050e167922: deleted successfully Jun 02 00:36:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "cinder-quobyte-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:36:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42" acquired by "delete_volume" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:36:21 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3488f49-7665-477a-9549-821fd1131c3f]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:21 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 Jun 02 00:36:21 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:22 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42" returned: 0 in 0.872s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:22 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42 Jun 02 00:36:22 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:23 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42" returned: 0 in 0.673s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-d0d4c9db-9229-4a09-9bb2-8bc2ee0a8a42" released by "delete_volume" :: held 1.656s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:36:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "cinder-quobyte-ed440afd-3c64-4d95-bae6-77cc9f3c9023" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:36:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-ed440afd-3c64-4d95-bae6-77cc9f3c9023" acquired by "delete_volume" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:36:23 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f533be24-2cb2-4cbc-869e-23ff0e1e8bd6]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-a92f227f-8b68-49d4-b8d1-6e190ce55fca req-446dc5d2-0a8d-4f9d-a7c2-45da538a4047 tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-a92f227f-8b68-49d4-b8d1-6e190ce55fca req-446dc5d2-0a8d-4f9d-a7c2-45da538a4047 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:23 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a9d500-b0fd-452a-a28f-578100799117]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-a92f227f-8b68-49d4-b8d1-6e190ce55fca req-446dc5d2-0a8d-4f9d-a7c2-45da538a4047 tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-772798e3-a920-4c85-90e1-32d8da769dee {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:23 devstack sudo[93358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023 Jun 02 00:36:23 devstack sudo[93358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:23 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-772798e3-a920-4c85-90e1-32d8da769dee Jun 02 00:36:23 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:24 devstack sudo[93358]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023" returned: 0 in 0.836s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:24 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023 Jun 02 00:36:24 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:24 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-a92f227f-8b68-49d4-b8d1-6e190ce55fca req-446dc5d2-0a8d-4f9d-a7c2-45da538a4047 tempest-AttachVolumeTestJSON-475729283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-772798e3-a920-4c85-90e1-32d8da769dee" returned: 0 in 0.818s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-a92f227f-8b68-49d4-b8d1-6e190ce55fca req-446dc5d2-0a8d-4f9d-a7c2-45da538a4047 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.835s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-a92f227f-8b68-49d4-b8d1-6e190ce55fca req-446dc5d2-0a8d-4f9d-a7c2-45da538a4047 tempest-AttachVolumeTestJSON-475729283 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-772798e3-a920-4c85-90e1-32d8da769dee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5abf7b45-dd77-4147-be64-b7fc4a1d9e92', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:36:24 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-a92f227f-8b68-49d4-b8d1-6e190ce55fca req-446dc5d2-0a8d-4f9d-a7c2-45da538a4047 tempest-AttachVolumeTestJSON-475729283 None] attachment_update completed successfully. Jun 02 00:36:24 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed440afd-3c64-4d95-bae6-77cc9f3c9023" returned: 0 in 0.670s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-ed440afd-3c64-4d95-bae6-77cc9f3c9023" released by "delete_volume" :: held 1.593s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:36:24 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Created reservations ['0e117c62-5b54-43eb-813a-8c0ff027d73b'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:36:24 devstack cinder-volume[86910]: WARNING cinder.quota [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2113841755 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2113841755, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:36:24 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Created reservations ['2bff7d07-6854-48a4-a93a-7ec988720574', '02db52d8-de25-4057-a3e2-8b1b838a40eb', 'c9845f12-c00b-4dd4-9832-71d5e62076e2', 'b2f81f33-411d-4d5e-85fd-662df91e55fc'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:36:25 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Created reservations ['86ab7009-03a6-407c-a0b0-657a19497198', 'e4e8662a-693e-4f0f-bb45-b5b418a154be', '78243802-0821-47c2-b5d1-6ae3406829cf', '86d0583f-694a-49e6-890e-0505ca207947'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:36:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:36:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:36:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:25 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:36:25 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:25 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.590s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:25 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:36:25 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a46f9e28-46aa-40f5-8f5c-cce4c3a3a95d tempest-GroupSnapshotsTest-2001499756 None] Delete group completed successfully. Jun 02 00:36:26 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ec4cb9cc-7a82-4cfa-bce7-0fc975582d11 tempest-GroupSnapshotsTest-2001499756 None] Group tempest-GroupSnapshotsTest-Group-523831712: creating Jun 02 00:36:26 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ec4cb9cc-7a82-4cfa-bce7-0fc975582d11 tempest-GroupSnapshotsTest-2001499756 None] Group tempest-GroupSnapshotsTest-Group-523831712: created successfully Jun 02 00:36:26 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ec4cb9cc-7a82-4cfa-bce7-0fc975582d11 tempest-GroupSnapshotsTest-2001499756 None] Create group completed successfully. Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Flow 'volume_create_manager' (061cec09-d262-4843-a12a-9bc03d4fd5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe43553-d033-4e89-b7bc-2ef83b52a8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe43553-d033-4e89-b7bc-2ef83b52a8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-362135395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d596f485-50d2-4b29-a263-293366f63c9c,host='devstack@QuobyteHD#QuobyteHD',id=2b3cd0a3-0730-4b80-8480-f9ae5f526876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857f6466f3e8446093144db540414a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:36:28Z,use_quota=True,user_id='c0af2dcb1fc8492fb099268a8ce388dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48435030-538a-4870-851a-d3c7195a14ec),volume_type_id=48435030-538a-4870-851a-d3c7195a14ec)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d136461-cecc-425d-a433-5f27f9e0028d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d136461-cecc-425d-a433-5f27f9e0028d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a76aea-b816-4ddc-a0d4-164db63ee449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a76aea-b816-4ddc-a0d4-164db63ee449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b3cd0a3-0730-4b80-8480-f9ae5f526876', 'volume_name': 'volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3548d71c-0d6e-4158-a0ae-2ea8f9f2d34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3548d71c-0d6e-4158-a0ae-2ea8f9f2d34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2272555-02e5-439c-a9da-50180b35c816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:28 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Volume 2b3cd0a3-0730-4b80-8480-f9ae5f526876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876', 'volume_size': 1} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d596f485-50d2-4b29-a263-293366f63c9c,created_at=2026-06-01T22:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-362135395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d596f485-50d2-4b29-a263-293366f63c9c,host='devstack@QuobyteHD#QuobyteHD',id=2b3cd0a3-0730-4b80-8480-f9ae5f526876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857f6466f3e8446093144db540414a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:36:28Z,use_quota=True,user_id='c0af2dcb1fc8492fb099268a8ce388dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48435030-538a-4870-851a-d3c7195a14ec),volume_type_id=48435030-538a-4870-851a-d3c7195a14ec)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Creating volume 2b3cd0a3-0730-4b80-8480-f9ae5f526876 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:36:28 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:28 devstack sudo[93399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876 1073741824 Jun 02 00:36:28 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:28 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876 1073741824" returned: 0 in 0.842s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:28 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876 Jun 02 00:36:29 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:29 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876" returned: 0 in 0.851s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:29 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:36:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2272555-02e5-439c-a9da-50180b35c816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcaf111-b1e3-412b-8fd8-4ac393568127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:29 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Volume volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876 (2b3cd0a3-0730-4b80-8480-f9ae5f526876): created successfully Jun 02 00:36:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcaf111-b1e3-412b-8fd8-4ac393568127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Flow 'volume_create_manager' (061cec09-d262-4843-a12a-9bc03d4fd5d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:36:29 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-41c4bdcd-9524-4f14-bcc1-d8286759917e tempest-GroupSnapshotsTest-2001499756 None] Created volume successfully. Jun 02 00:36:30 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-e9390ea9-8448-4aff-b356-4689e803ca20 req-28e9483d-0362-4a78-907f-625bbb1aad6d tempest-AttachVolumeTestJSON-475729283 None] Terminate volume connection completed successfully. Jun 02 00:36:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-e9390ea9-8448-4aff-b356-4689e803ca20 req-28e9483d-0362-4a78-907f-625bbb1aad6d tempest-AttachVolumeTestJSON-475729283 None] Deleting attachment 47ddac59-7cb2-4f66-95d0-d2286f6c7f4f. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:36:30 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] GroupSnapshot b535596d-b1e8-4d28-9e9c-14148f368985: creating. Jun 02 00:36:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] Group snapshot b535596d-b1e8-4d28-9e9c-14148f368985: creating. {{(pid=86910) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 02 00:36:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] Creating offline snapshot 8288150a-2ad4-49ac-84f8-4461cbb97381 of volume 2b3cd0a3-0730-4b80-8480-f9ae5f526876 {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:36:30 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d0a930-678c-4a11-b2dc-01e3a8fdca8a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:30 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876 Jun 02 00:36:30 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:31 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876" returned: 0 in 0.909s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:31 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381 1G Jun 02 00:36:31 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:32 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381 1G" returned: 0 in 0.995s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:32 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381 Jun 02 00:36:32 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:33 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381" returned: 0 in 0.682s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:33 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381 is being set with open permissions: ugo+rw: NotImplementedError Jun 02 00:36:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:33 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381 Jun 02 00:36:33 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:34 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-90c45df3-3f3f-48e2-901f-6cef62234cef req-531ba6cb-9c0c-4df2-ab88-a4e21f8893ab tempest-AttachVolumeTestJSON-475729283 None] Terminate volume connection completed successfully. Jun 02 00:36:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-90c45df3-3f3f-48e2-901f-6cef62234cef req-531ba6cb-9c0c-4df2-ab88-a4e21f8893ab tempest-AttachVolumeTestJSON-475729283 None] Deleting attachment 5abf7b45-dd77-4147-be64-b7fc4a1d9e92. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:36:34 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381" returned: 0 in 0.832s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:34 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.info Jun 02 00:36:34 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:34 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:36:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Flow 'volume_create_manager' (782edada-21ef-475f-b4b8-cfa0c3ad3e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:36:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd057989-7c74-421c-bda5-5ab612d9287e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd057989-7c74-421c-bda5-5ab612d9287e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-20826011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a41414b-150b-495a-84a9-3ec289082510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa3be2c9b44f3abb73a4974ca4b7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:36:35Z,use_quota=True,user_id='36cff72b287c40c4a0c74a597658e506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f13e1b-b644-473b-935a-d52eb81c3895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f13e1b-b644-473b-935a-d52eb81c3895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbeaa699-988f-48b6-9b8b-c39e138c1689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbeaa699-988f-48b6-9b8b-c39e138c1689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a41414b-150b-495a-84a9-3ec289082510', 'volume_name': 'volume-8a41414b-150b-495a-84a9-3ec289082510', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea9d26b-83a8-4349-8fda-af23dff92c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea9d26b-83a8-4349-8fda-af23dff92c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eda5a67-cb9f-4850-a2d1-e4306e88d741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:34 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Volume 8a41414b-150b-495a-84a9-3ec289082510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a41414b-150b-495a-84a9-3ec289082510', 'volume_size': 1} Jun 02 00:36:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:35 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.info" returned: 0 in 0.903s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:35 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 00:36:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:35 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.info Jun 02 00:36:35 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:35 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.info" returned: 0 in 0.620s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.020s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.951s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-20826011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a41414b-150b-495a-84a9-3ec289082510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa3be2c9b44f3abb73a4974ca4b7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:36:35Z,use_quota=True,user_id='36cff72b287c40c4a0c74a597658e506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:36:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Creating volume 8a41414b-150b-495a-84a9-3ec289082510 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:36:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:36:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:36:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:36:35 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:36:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8a41414b-150b-495a-84a9-3ec289082510 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:35 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=115,cinder:UPDATE=113,cinder:INSERT=26,cinder:DELETE=4 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:36:35 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8a41414b-150b-495a-84a9-3ec289082510 1073741824 Jun 02 00:36:35 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:35 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=116,cinder:UPDATE=109,cinder:INSERT=23,cinder:DELETE=5 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:36:35 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-d3bf0b1d-3acd-40cb-bf19-7787515738cc tempest-GroupSnapshotsTest-2001499756 None] group_snapshot b535596d-b1e8-4d28-9e9c-14148f368985: created successfully Jun 02 00:36:36 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] group_snapshot b535596d-b1e8-4d28-9e9c-14148f368985: deleting Jun 02 00:36:36 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] group_snapshot b535596d-b1e8-4d28-9e9c-14148f368985: deleting {{(pid=86910) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 02 00:36:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "cinder-quobyte-2b3cd0a3-0730-4b80-8480-f9ae5f526876" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:36:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-2b3cd0a3-0730-4b80-8480-f9ae5f526876" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:36:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "cinder-quobyte-8288150a-2ad4-49ac-84f8-4461cbb97381" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:36:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-8288150a-2ad4-49ac-84f8-4461cbb97381" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:36:36 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] Deleting offline snapshot 8288150a-2ad4-49ac-84f8-4461cbb97381 of volume 2b3cd0a3-0730-4b80-8480-f9ae5f526876 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:36:36 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] snapshot_file for this snap is: volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:36:36 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af6123f-b8c0-436d-9d32-b39f8cc1b207]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:36 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381 Jun 02 00:36:36 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:36 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8a41414b-150b-495a-84a9-3ec289082510 1073741824" returned: 0 in 1.141s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8a41414b-150b-495a-84a9-3ec289082510 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:37 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8a41414b-150b-495a-84a9-3ec289082510 Jun 02 00:36:37 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:37 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381" returned: 0 in 0.878s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:36:37 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2760acd-a6b1-45b6-9b80-ea6ed5de3891]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:37 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876 Jun 02 00:36:37 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:37 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8a41414b-150b-495a-84a9-3ec289082510" returned: 0 in 0.677s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:36:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eda5a67-cb9f-4850-a2d1-e4306e88d741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a41414b-150b-495a-84a9-3ec289082510', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a7e53b-30f0-4da8-a373-1473857a7654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:37 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Volume volume-8a41414b-150b-495a-84a9-3ec289082510 (8a41414b-150b-495a-84a9-3ec289082510): created successfully Jun 02 00:36:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a7e53b-30f0-4da8-a373-1473857a7654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Flow 'volume_create_manager' (782edada-21ef-475f-b4b8-cfa0c3ad3e8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:36:37 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-b1e1fb64-c90e-4ead-934c-30c8f67292d0 tempest-AttachVolumeNegativeTest-77772747 None] Created volume successfully. Jun 02 00:36:38 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876" returned: 0 in 1.247s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:38 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381 Jun 02 00:36:38 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:39 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381" returned: 0 in 0.741s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:39 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381 Jun 02 00:36:39 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:40 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876.8288150a-2ad4-49ac-84f8-4461cbb97381" returned: 0 in 0.692s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-8288150a-2ad4-49ac-84f8-4461cbb97381" released by "_delete_snapshot" :: held 3.756s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:36:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-2b3cd0a3-0730-4b80-8480-f9ae5f526876" released by "delete_snapshot" :: held 3.784s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:36:40 devstack cinder-volume[86910]: WARNING cinder.quota [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1314579802 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1314579802, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:36:40 devstack cinder-volume[86910]: WARNING cinder.quota [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1314579802 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1314579802, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:36:40 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] Created reservations ['28365284-e2a3-46b3-8b80-5ca61d50c0c2', 'b9f703f1-2115-4c49-b16d-3e3c7168d0c4', 'ad3ebe46-38ed-4b0c-8d37-897f1ede8b74', '89b91bd2-8f4c-44bd-ad47-5ab1160764be'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:36:40 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-388c634c-e926-4db3-8768-9700ff9ce0a8 tempest-GroupSnapshotsTest-2001499756 None] group_snapshot b535596d-b1e8-4d28-9e9c-14148f368985: deleted successfully Jun 02 00:36:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "cinder-quobyte-2b3cd0a3-0730-4b80-8480-f9ae5f526876" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:36:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-2b3cd0a3-0730-4b80-8480-f9ae5f526876" acquired by "delete_volume" :: waited 0.016s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:36:41 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[63907ef8-7b71-4a69-8d07-257bc528688c]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:41 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876 Jun 02 00:36:41 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-510bf527-ac20-47cf-9ff1-ff62b8d7b6e3 req-3994fb48-1879-4ffe-9f98-0cbc042e4976 tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-510bf527-ac20-47cf-9ff1-ff62b8d7b6e3 req-3994fb48-1879-4ffe-9f98-0cbc042e4976 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:41 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b92b40-05a3-4aec-bd5e-177e7fe456c4]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-510bf527-ac20-47cf-9ff1-ff62b8d7b6e3 req-3994fb48-1879-4ffe-9f98-0cbc042e4976 tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8a41414b-150b-495a-84a9-3ec289082510 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:41 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8a41414b-150b-495a-84a9-3ec289082510 Jun 02 00:36:41 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:42 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876" returned: 0 in 0.792s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:42 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876 Jun 02 00:36:42 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:42 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-510bf527-ac20-47cf-9ff1-ff62b8d7b6e3 req-3994fb48-1879-4ffe-9f98-0cbc042e4976 tempest-AttachVolumeNegativeTest-77772747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8a41414b-150b-495a-84a9-3ec289082510" returned: 0 in 0.879s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-510bf527-ac20-47cf-9ff1-ff62b8d7b6e3 req-3994fb48-1879-4ffe-9f98-0cbc042e4976 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.898s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:42 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-510bf527-ac20-47cf-9ff1-ff62b8d7b6e3 req-3994fb48-1879-4ffe-9f98-0cbc042e4976 tempest-AttachVolumeNegativeTest-77772747 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-8a41414b-150b-495a-84a9-3ec289082510', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'afcbb701-29ca-4ecb-81b3-b8c5045d4bed', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:36:42 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-510bf527-ac20-47cf-9ff1-ff62b8d7b6e3 req-3994fb48-1879-4ffe-9f98-0cbc042e4976 tempest-AttachVolumeNegativeTest-77772747 None] attachment_update completed successfully. Jun 02 00:36:42 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2b3cd0a3-0730-4b80-8480-f9ae5f526876" returned: 0 in 0.666s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] Lock "cinder-quobyte-2b3cd0a3-0730-4b80-8480-f9ae5f526876" released by "delete_volume" :: held 1.570s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:36:42 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] Created reservations ['73bc89d9-e300-43f5-9157-97c9f07fe538'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:36:42 devstack cinder-volume[86910]: WARNING cinder.quota [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1314579802 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1314579802, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:36:42 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] Created reservations ['5b7d644e-c87e-4c38-ba84-2d7aec2c3156', '89ff2012-2f5d-4e20-9188-e6b53cd42efd', '125f342f-8868-4b6a-b04d-2d1ace546928', 'c09542f7-2e6f-4c15-946c-39a0c1f07197'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:36:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:36:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:36:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:43 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:36:43 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:43 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.678s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:43 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:36:43 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-31a92eac-83ea-4b12-a407-9d7d2b633a55 tempest-GroupSnapshotsTest-2001499756 None] Delete group completed successfully. Jun 02 00:36:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "cinder-772798e3-a920-4c85-90e1-32d8da769dee-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:36:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] Lock "cinder-772798e3-a920-4c85-90e1-32d8da769dee-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:36:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "cinder-quobyte-772798e3-a920-4c85-90e1-32d8da769dee" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:36:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] Lock "cinder-quobyte-772798e3-a920-4c85-90e1-32d8da769dee" acquired by "delete_volume" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:36:45 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92a5a0f-3d35-4181-a965-ade721a1e5f6]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-772798e3-a920-4c85-90e1-32d8da769dee {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:45 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-772798e3-a920-4c85-90e1-32d8da769dee Jun 02 00:36:45 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:46 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-772798e3-a920-4c85-90e1-32d8da769dee" returned: 0 in 0.739s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-772798e3-a920-4c85-90e1-32d8da769dee {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:46 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-772798e3-a920-4c85-90e1-32d8da769dee Jun 02 00:36:46 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:47 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-772798e3-a920-4c85-90e1-32d8da769dee" returned: 0 in 0.606s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] Lock "cinder-quobyte-772798e3-a920-4c85-90e1-32d8da769dee" released by "delete_volume" :: held 1.390s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:36:47 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] Created reservations ['974f17b1-8494-4106-94c6-9ac85c93fa0c', '063a69cc-af9e-4b29-88cf-cb1a7f7d2546', 'ed9163ec-d3d1-4252-b59f-40f6c07ae737', 'db612c04-a17f-414c-8795-43f838564294'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:36:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:36:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:36:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:47 devstack sudo[94042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:36:47 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:47 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.597s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:47 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:36:47 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] Deleted volume successfully. Jun 02 00:36:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5c736da7-69da-4159-b3e4-ac07cf836485 tempest-AttachVolumeTestJSON-475729283 None] Lock "cinder-772798e3-a920-4c85-90e1-32d8da769dee-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:36:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "cinder-82782284-4d6f-4b8e-89b5-a29c2e562e5c-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:36:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] Lock "cinder-82782284-4d6f-4b8e-89b5-a29c2e562e5c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:36:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "cinder-quobyte-82782284-4d6f-4b8e-89b5-a29c2e562e5c" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:36:48 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] Lock "cinder-quobyte-82782284-4d6f-4b8e-89b5-a29c2e562e5c" acquired by "delete_volume" :: waited 0.020s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:36:48 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b356cb-a018-44c4-bbd4-ccd118e51b72]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:48 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c Jun 02 00:36:48 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:48 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c" returned: 0 in 0.738s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:48 devstack sudo[94050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c Jun 02 00:36:48 devstack sudo[94050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:49 devstack sudo[94050]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-82782284-4d6f-4b8e-89b5-a29c2e562e5c" returned: 0 in 0.696s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:49 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-fa7eddec-556e-49c1-8366-79d84f97777d req-6091d0b0-052e-478a-8990-fbea5a632eb0 tempest-AttachVolumeNegativeTest-77772747 None] Terminate volume connection completed successfully. Jun 02 00:36:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-fa7eddec-556e-49c1-8366-79d84f97777d req-6091d0b0-052e-478a-8990-fbea5a632eb0 tempest-AttachVolumeNegativeTest-77772747 None] Deleting attachment afcbb701-29ca-4ecb-81b3-b8c5045d4bed. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:36:49 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] Lock "cinder-quobyte-82782284-4d6f-4b8e-89b5-a29c2e562e5c" released by "delete_volume" :: held 1.491s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:36:49 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] Created reservations ['954eceb6-febb-46ec-bae2-8471e5971d61', 'a9632227-3d4b-4335-a351-bb10e6ea5804', '2bf7feb4-7d73-4d46-8494-42e0bc623cb0', '7cb30a95-e898-4768-a42d-821aeb1377fe'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:36:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:36:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:36:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:49 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:36:49 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:50 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.729s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:50 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:36:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "cinder-5470959e-e659-4047-909f-bfb176b81319-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:36:50 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] Deleted volume successfully. Jun 02 00:36:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-762c835c-c0fe-4ced-832f-93ade84e12ad tempest-AttachVolumeTestJSON-475729283 None] Lock "cinder-82782284-4d6f-4b8e-89b5-a29c2e562e5c-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:36:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] Lock "cinder-5470959e-e659-4047-909f-bfb176b81319-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:36:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "cinder-quobyte-5470959e-e659-4047-909f-bfb176b81319" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:36:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] Lock "cinder-quobyte-5470959e-e659-4047-909f-bfb176b81319" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:36:50 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b119fc-d4db-4bff-b4b6-1cc3e94eec5d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:36:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5470959e-e659-4047-909f-bfb176b81319 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:50 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5470959e-e659-4047-909f-bfb176b81319 Jun 02 00:36:50 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:51 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5470959e-e659-4047-909f-bfb176b81319" returned: 0 in 0.889s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5470959e-e659-4047-909f-bfb176b81319 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:51 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5470959e-e659-4047-909f-bfb176b81319 Jun 02 00:36:51 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:52 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5470959e-e659-4047-909f-bfb176b81319" returned: 0 in 0.720s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:52 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] Lock "cinder-quobyte-5470959e-e659-4047-909f-bfb176b81319" released by "delete_volume" :: held 1.686s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:36:52 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] Created reservations ['10435c0d-658c-4115-abf9-73060917b6b6', 'a155ad8f-85ac-4930-be36-5ac7e8995fe2', '42e21a91-c2f2-4d38-9e2d-99630e8a2ca0', '6bbe4925-077b-4a59-a9fa-efda854e79f8'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:36:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:36:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:36:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:52 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:36:52 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:53 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.955s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:53 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:36:53 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] Deleted volume successfully. Jun 02 00:36:53 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-41c3bd85-e4f1-4cba-996c-78c0e3c6bf63 tempest-AttachVolumeTestJSON-475729283 None] Lock "cinder-5470959e-e659-4047-909f-bfb176b81319-delete_volume" released by "delete_volume" :: held 2.914s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Flow 'volume_create_manager' (e4e56e3e-e234-47c9-bebd-a69a4a739cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8531b0eb-70e7-4cce-934a-70370114f1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8531b0eb-70e7-4cce-934a-70370114f1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1458320275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1c89ab-404d-4ddc-b867-9f4cd8b08152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a3586c6f00c4268ae83b0472363ce70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:36:56Z,use_quota=True,user_id='b83f53be71d74fc79c4f967bd4ec6e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987efc75-29b6-49d3-b0a4-06a4ae236b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987efc75-29b6-49d3-b0a4-06a4ae236b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afc512f-c686-49ea-a663-843ba291366f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afc512f-c686-49ea-a663-843ba291366f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab1c89ab-404d-4ddc-b867-9f4cd8b08152', 'volume_name': 'volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6a4919-2f43-42b7-a6e7-37bae6463d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6a4919-2f43-42b7-a6e7-37bae6463d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504d33b9-5f54-47bc-9c56-7cf42dcf9920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:55 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Volume ab1c89ab-404d-4ddc-b867-9f4cd8b08152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152', 'volume_size': 1} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1458320275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1c89ab-404d-4ddc-b867-9f4cd8b08152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a3586c6f00c4268ae83b0472363ce70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:36:56Z,use_quota=True,user_id='b83f53be71d74fc79c4f967bd4ec6e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Creating volume ab1c89ab-404d-4ddc-b867-9f4cd8b08152 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:36:55 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:36:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:55 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152 1073741824 Jun 02 00:36:55 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:56 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152 1073741824" returned: 0 in 1.014s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:36:56 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152 Jun 02 00:36:56 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:36:57 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Jun 02 00:36:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152" returned: 0 in 0.790s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:36:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:36:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:36:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504d33b9-5f54-47bc-9c56-7cf42dcf9920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebe21fc-422e-48eb-b6eb-502a1dccbccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:36:57 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Volume volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152 (ab1c89ab-404d-4ddc-b867-9f4cd8b08152): created successfully Jun 02 00:36:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebe21fc-422e-48eb-b6eb-502a1dccbccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:36:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Flow 'volume_create_manager' (e4e56e3e-e234-47c9-bebd-a69a4a739cc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:36:57 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-0351e7ac-cadf-467b-a7f8-6bf53e7ab165 tempest-AttachVolumeShelveTestJSON-425694257 None] Created volume successfully. Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Flow 'volume_create_manager' (31f1dbe6-c5f9-44e2-a6e7-a61a624e5f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee6ba03-8b52-473e-8691-a99f9722ae46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee6ba03-8b52-473e-8691-a99f9722ae46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1156884195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb124b44-d306-49e3-a81e-86a936d3b07e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b6843f87cda4a938414f381273f9677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:37:03Z,use_quota=True,user_id='1e7b268373d64a6d92fef5597aa2b305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8bc34c-9e80-4bdb-8a90-983e1db3cd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8bc34c-9e80-4bdb-8a90-983e1db3cd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834de350-6290-4aad-a77f-5197a9309f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834de350-6290-4aad-a77f-5197a9309f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb124b44-d306-49e3-a81e-86a936d3b07e', 'volume_name': 'volume-cb124b44-d306-49e3-a81e-86a936d3b07e', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5325a8-6a49-4d06-b52e-a5cc088ac971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5325a8-6a49-4d06-b52e-a5cc088ac971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d727d0ef-8ef0-469a-9f37-908ceee747d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:02 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Volume cb124b44-d306-49e3-a81e-86a936d3b07e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb124b44-d306-49e3-a81e-86a936d3b07e', 'volume_size': 1} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1156884195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb124b44-d306-49e3-a81e-86a936d3b07e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b6843f87cda4a938414f381273f9677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:37:03Z,use_quota=True,user_id='1e7b268373d64a6d92fef5597aa2b305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Creating volume cb124b44-d306-49e3-a81e-86a936d3b07e {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:37:02 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:37:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cb124b44-d306-49e3-a81e-86a936d3b07e 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:02 devstack sudo[94203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cb124b44-d306-49e3-a81e-86a936d3b07e 1073741824 Jun 02 00:37:02 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:04 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cb124b44-d306-49e3-a81e-86a936d3b07e 1073741824" returned: 0 in 1.152s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cb124b44-d306-49e3-a81e-86a936d3b07e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:04 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cb124b44-d306-49e3-a81e-86a936d3b07e Jun 02 00:37:04 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:04 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cb124b44-d306-49e3-a81e-86a936d3b07e" returned: 0 in 0.692s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:37:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:37:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d727d0ef-8ef0-469a-9f37-908ceee747d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb124b44-d306-49e3-a81e-86a936d3b07e', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94eea372-5325-4f28-9fab-34bd559e51d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:04 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Volume volume-cb124b44-d306-49e3-a81e-86a936d3b07e (cb124b44-d306-49e3-a81e-86a936d3b07e): created successfully Jun 02 00:37:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94eea372-5325-4f28-9fab-34bd559e51d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Flow 'volume_create_manager' (31f1dbe6-c5f9-44e2-a6e7-a61a624e5f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:37:04 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-d3d5c74d-3966-46a3-a472-7524ed990872 req-9c02c456-515a-4e7b-a2a1-6344d14ccb46 tempest-VolumesGetTestJSON-452947355 None] Created volume successfully. Jun 02 00:37:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] Acquiring lock "cinder-cb124b44-d306-49e3-a81e-86a936d3b07e-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:37:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] Lock "cinder-cb124b44-d306-49e3-a81e-86a936d3b07e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:37:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] Acquiring lock "cinder-quobyte-cb124b44-d306-49e3-a81e-86a936d3b07e" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:37:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] Lock "cinder-quobyte-cb124b44-d306-49e3-a81e-86a936d3b07e" acquired by "delete_volume" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:37:05 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[695aff7b-6e87-4400-bada-4bfc0ab20337]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:37:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cb124b44-d306-49e3-a81e-86a936d3b07e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:06 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cb124b44-d306-49e3-a81e-86a936d3b07e Jun 02 00:37:06 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:06 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cb124b44-d306-49e3-a81e-86a936d3b07e" returned: 0 in 0.882s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cb124b44-d306-49e3-a81e-86a936d3b07e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:06 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cb124b44-d306-49e3-a81e-86a936d3b07e Jun 02 00:37:06 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:07 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cb124b44-d306-49e3-a81e-86a936d3b07e" returned: 0 in 0.878s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] Lock "cinder-quobyte-cb124b44-d306-49e3-a81e-86a936d3b07e" released by "delete_volume" :: held 1.837s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:37:07 devstack cinder-volume[86910]: DEBUG cinder.quota [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] Created reservations ['2d2d8976-09e2-44ba-a18c-1bed4826e82c', '3256318e-4fea-4f20-b55a-dfc0656e31b6', 'b198e6ad-81da-4050-9334-cd46338af90e', 'da389801-41fb-496b-bd77-08f2b8f0c876'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:37:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:37:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:37:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:37:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:37:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:37:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:07 devstack sudo[94231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:37:07 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:08 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.879s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:08 devstack cinder-volume[86910]: DEBUG cinder.manager [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:37:08 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] Deleted volume successfully. Jun 02 00:37:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-67d46066-486b-4164-85c2-2cb1bdfe65b6 req-29e4de79-0a8e-4797-b816-fed229c24f30 tempest-VolumesGetTestJSON-452947355 None] Lock "cinder-cb124b44-d306-49e3-a81e-86a936d3b07e-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:37:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e4823043-11fe-4a97-aa92-a1dc398170e7 tempest-BackendsCapabilitiesAdminTestsJSON-191411851 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86910) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 02 00:37:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f504622e-c385-41a8-a5f0-bd0b4dd50f01 tempest-BackendsCapabilitiesAdminTestsJSON-191411851 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86910) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 02 00:37:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:37:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:37:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:37:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:37:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:37:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:37:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:15 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:37:15 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:16 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.927s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:16 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:37:17 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=44,cinder:UPDATE=55,cinder:INSERT=17,cinder:DELETE=3 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:37:18 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=56,cinder:UPDATE=65,cinder:DELETE=4,cinder:INSERT=11 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:37:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-9b32c929-a173-47d5-b290-54a030a53e30 req-0cda323b-5726-4687-97d6-30ad72ed5512 tempest-AttachVolumeShelveTestJSON-425694257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:37:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-9b32c929-a173-47d5-b290-54a030a53e30 req-0cda323b-5726-4687-97d6-30ad72ed5512 tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:37:22 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bb9af6-244b-4cbd-82c0-74afb0052dac]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:37:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-9b32c929-a173-47d5-b290-54a030a53e30 req-0cda323b-5726-4687-97d6-30ad72ed5512 tempest-AttachVolumeShelveTestJSON-425694257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:22 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152 Jun 02 00:37:22 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:23 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-9b32c929-a173-47d5-b290-54a030a53e30 req-0cda323b-5726-4687-97d6-30ad72ed5512 tempest-AttachVolumeShelveTestJSON-425694257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152" returned: 0 in 1.079s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-9b32c929-a173-47d5-b290-54a030a53e30 req-0cda323b-5726-4687-97d6-30ad72ed5512 tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.110s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:37:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-9b32c929-a173-47d5-b290-54a030a53e30 req-0cda323b-5726-4687-97d6-30ad72ed5512 tempest-AttachVolumeShelveTestJSON-425694257 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f6d17a2-8a95-4b4b-b625-b4ab8ff9d7c7', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:37:23 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-9b32c929-a173-47d5-b290-54a030a53e30 req-0cda323b-5726-4687-97d6-30ad72ed5512 tempest-AttachVolumeShelveTestJSON-425694257 None] attachment_update completed successfully. Jun 02 00:37:33 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:37:33 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=5 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Flow 'volume_create_manager' (d1f3a9ac-02b8-4808-9618-1f014adc2183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e7f9d4-487c-472f-9e5f-622db3b7f76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e7f9d4-487c-472f-9e5f-622db3b7f76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1165545368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5784a6-a5eb-4f4e-9b64-753a8db63c7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8736d8a7076a421a9b77fac8efe02b2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:37:40Z,use_quota=True,user_id='661156c1d84c4e8ca66b3cc939637d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b0dc1d-c420-40dc-93cf-ce0a6c00e28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b0dc1d-c420-40dc-93cf-ce0a6c00e28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d360c693-ffed-43fd-ae7b-b3215414adc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d360c693-ffed-43fd-ae7b-b3215414adc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce5784a6-a5eb-4f4e-9b64-753a8db63c7f', 'volume_name': 'volume-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5054d9ff-8491-4171-9557-c92decffeab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5054d9ff-8491-4171-9557-c92decffeab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d2c9cd-3866-4c52-979d-858f22850386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:40 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Volume ce5784a6-a5eb-4f4e-9b64-753a8db63c7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f', 'volume_size': 1} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1165545368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5784a6-a5eb-4f4e-9b64-753a8db63c7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8736d8a7076a421a9b77fac8efe02b2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:37:40Z,use_quota=True,user_id='661156c1d84c4e8ca66b3cc939637d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Creating volume ce5784a6-a5eb-4f4e-9b64-753a8db63c7f {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:37:40 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:37:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:40 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f 1073741824 Jun 02 00:37:40 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:41 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f 1073741824" returned: 0 in 0.920s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:41 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f Jun 02 00:37:41 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:42 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f" returned: 0 in 0.584s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:42 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:37:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:37:42 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d2c9cd-3866-4c52-979d-858f22850386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:42 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31bf89a-1868-4bc6-a5a1-682d8185b1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:42 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Volume volume-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f (ce5784a6-a5eb-4f4e-9b64-753a8db63c7f): created successfully Jun 02 00:37:42 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31bf89a-1868-4bc6-a5a1-682d8185b1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:42 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Flow 'volume_create_manager' (d1f3a9ac-02b8-4808-9618-1f014adc2183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:37:42 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-d8462502-f705-472d-82df-f7b73068a097 tempest-VolumesServicesTestJSON-504805688 None] Created volume successfully. Jun 02 00:37:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] Acquiring lock "cinder-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:37:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] Lock "cinder-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:37:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] Acquiring lock "cinder-quobyte-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:37:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] Lock "cinder-quobyte-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f" acquired by "delete_volume" :: waited 0.022s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:37:43 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aeb2fc-d2ef-429e-b6af-a9e0198a6d0d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:37:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:43 devstack sudo[94884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f Jun 02 00:37:43 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:44 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f" returned: 0 in 1.247s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:44 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f Jun 02 00:37:44 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Flow 'volume_create_manager' (354bce14-4aa1-436b-ae27-d4acf74da02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea8618e-2187-42fe-b2cc-50cfa7048d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea8618e-2187-42fe-b2cc-50cfa7048d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-706388538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479824b7-c563-4641-9d89-7e0667c390c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa3be2c9b44f3abb73a4974ca4b7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:37:44Z,use_quota=True,user_id='36cff72b287c40c4a0c74a597658e506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3a0cab-559b-4dbf-a25c-6d69dcee5a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3a0cab-559b-4dbf-a25c-6d69dcee5a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9a68ac-9a07-45b7-b9ca-05ca4cc49934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9a68ac-9a07-45b7-b9ca-05ca4cc49934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '479824b7-c563-4641-9d89-7e0667c390c0', 'volume_name': 'volume-479824b7-c563-4641-9d89-7e0667c390c0', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367d195a-5357-4d92-843c-ba67b3b76878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367d195a-5357-4d92-843c-ba67b3b76878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edea88ee-1e18-42a8-a3e3-95e5ad601a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:44 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Volume 479824b7-c563-4641-9d89-7e0667c390c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-479824b7-c563-4641-9d89-7e0667c390c0', 'volume_size': 1} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-706388538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479824b7-c563-4641-9d89-7e0667c390c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa3be2c9b44f3abb73a4974ca4b7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:37:44Z,use_quota=True,user_id='36cff72b287c40c4a0c74a597658e506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Creating volume 479824b7-c563-4641-9d89-7e0667c390c0 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:37:44 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:37:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-479824b7-c563-4641-9d89-7e0667c390c0 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:44 devstack sudo[94939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-479824b7-c563-4641-9d89-7e0667c390c0 1073741824 Jun 02 00:37:44 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:45 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f" returned: 0 in 0.845s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] Lock "cinder-quobyte-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f" released by "delete_volume" :: held 2.229s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:37:45 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] Created reservations ['61b6ae66-ad0a-45fe-8e16-34f9ebfaa442', 'e753a25d-6fb5-4bca-98d9-f23954a6e3ce', '8c3f5f20-7d29-4065-9823-f6d980351894', '26c2c75b-e509-44e8-9a9a-66f03deb3ed0'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:37:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:37:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:37:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:37:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:37:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:37:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:45 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:37:45 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:45 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-479824b7-c563-4641-9d89-7e0667c390c0 1073741824" returned: 0 in 1.184s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-479824b7-c563-4641-9d89-7e0667c390c0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:45 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-479824b7-c563-4641-9d89-7e0667c390c0 Jun 02 00:37:45 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:46 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.730s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:46 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:37:46 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] Deleted volume successfully. Jun 02 00:37:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ad46ffda-7e0c-45af-88de-c9a240d87c97 tempest-VolumesServicesTestJSON-504805688 None] Lock "cinder-ce5784a6-a5eb-4f4e-9b64-753a8db63c7f-delete_volume" released by "delete_volume" :: held 3.306s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:37:47 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-479824b7-c563-4641-9d89-7e0667c390c0" returned: 0 in 1.196s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] <== create_volume: return (2426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:37:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.428s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:37:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edea88ee-1e18-42a8-a3e3-95e5ad601a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-479824b7-c563-4641-9d89-7e0667c390c0', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57155e8-e977-4f12-8536-17ed7314b2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:47 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Volume volume-479824b7-c563-4641-9d89-7e0667c390c0 (479824b7-c563-4641-9d89-7e0667c390c0): created successfully Jun 02 00:37:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57155e8-e977-4f12-8536-17ed7314b2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Flow 'volume_create_manager' (354bce14-4aa1-436b-ae27-d4acf74da02b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:37:47 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-0d6ef793-d9c0-4468-ae87-a9fbd432eac4 tempest-AttachVolumeNegativeTest-77772747 None] Created volume successfully. Jun 02 00:37:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-f5053c94-93ac-4276-939b-e16612a27891 req-63366134-4316-409a-a3a8-ae91adbf0b3b tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:37:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-f5053c94-93ac-4276-939b-e16612a27891 req-63366134-4316-409a-a3a8-ae91adbf0b3b tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:37:51 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc73dd0-b795-49f6-9001-0a3d14d01632]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:37:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-f5053c94-93ac-4276-939b-e16612a27891 req-63366134-4316-409a-a3a8-ae91adbf0b3b tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-479824b7-c563-4641-9d89-7e0667c390c0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:51 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-479824b7-c563-4641-9d89-7e0667c390c0 Jun 02 00:37:51 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:51 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:37:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Flow 'volume_create_manager' (8cfffbe0-ee18-4996-b8f0-fd07b4068a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:37:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2969619e-55da-4ec6-865b-e069ce4ccd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2969619e-55da-4ec6-865b-e069ce4ccd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1016346880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c12a27-87ce-4405-8ca7-0d21e615feb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fccf7694c2bc40098c357fff930fc2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:37:52Z,use_quota=True,user_id='7a433c0692d44abd85716fa4af921426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deab4aba-4c8a-45b9-b35d-eef20779c4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deab4aba-4c8a-45b9-b35d-eef20779c4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4585292-25a1-4c33-9946-16fe4eb3b952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4585292-25a1-4c33-9946-16fe4eb3b952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7c12a27-87ce-4405-8ca7-0d21e615feb0', 'volume_name': 'volume-f7c12a27-87ce-4405-8ca7-0d21e615feb0', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290fe65c-db9f-4192-9fd7-3ff4fc927acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290fe65c-db9f-4192-9fd7-3ff4fc927acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b2ee37a-c2a5-4517-bd1b-d54ba607fb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:51 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Volume f7c12a27-87ce-4405-8ca7-0d21e615feb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7c12a27-87ce-4405-8ca7-0d21e615feb0', 'volume_size': 1} Jun 02 00:37:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:37:52 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-f5053c94-93ac-4276-939b-e16612a27891 req-63366134-4316-409a-a3a8-ae91adbf0b3b tempest-AttachVolumeNegativeTest-77772747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-479824b7-c563-4641-9d89-7e0667c390c0" returned: 0 in 0.838s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-f5053c94-93ac-4276-939b-e16612a27891 req-63366134-4316-409a-a3a8-ae91adbf0b3b tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.877s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:37:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.154s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:37:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1016346880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c12a27-87ce-4405-8ca7-0d21e615feb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fccf7694c2bc40098c357fff930fc2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:37:52Z,use_quota=True,user_id='7a433c0692d44abd85716fa4af921426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:37:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Creating volume f7c12a27-87ce-4405-8ca7-0d21e615feb0 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:37:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:37:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:37:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:37:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:37:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:37:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:37:52 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:37:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f7c12a27-87ce-4405-8ca7-0d21e615feb0 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:52 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f7c12a27-87ce-4405-8ca7-0d21e615feb0 1073741824 Jun 02 00:37:52 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-f5053c94-93ac-4276-939b-e16612a27891 req-63366134-4316-409a-a3a8-ae91adbf0b3b tempest-AttachVolumeNegativeTest-77772747 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-479824b7-c563-4641-9d89-7e0667c390c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd533f0a9-f4a7-4574-98e8-f5ddaceef46c', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:37:52 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-f5053c94-93ac-4276-939b-e16612a27891 req-63366134-4316-409a-a3a8-ae91adbf0b3b tempest-AttachVolumeNegativeTest-77772747 None] attachment_update completed successfully. Jun 02 00:37:53 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f7c12a27-87ce-4405-8ca7-0d21e615feb0 1073741824" returned: 0 in 1.214s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f7c12a27-87ce-4405-8ca7-0d21e615feb0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:53 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f7c12a27-87ce-4405-8ca7-0d21e615feb0 Jun 02 00:37:53 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:54 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f7c12a27-87ce-4405-8ca7-0d21e615feb0" returned: 0 in 0.876s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.160s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b2ee37a-c2a5-4517-bd1b-d54ba607fb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7c12a27-87ce-4405-8ca7-0d21e615feb0', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c86e6a8-65ce-43e2-8477-70c6c343ada0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:54 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Volume volume-f7c12a27-87ce-4405-8ca7-0d21e615feb0 (f7c12a27-87ce-4405-8ca7-0d21e615feb0): created successfully Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c86e6a8-65ce-43e2-8477-70c6c343ada0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Flow 'volume_create_manager' (8cfffbe0-ee18-4996-b8f0-fd07b4068a6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:37:54 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-b6fce713-2395-4f21-a173-f62fdac12f0c tempest-VolumesActionsTest-576200696 None] Created volume successfully. Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Flow 'volume_create_manager' (7dc8e9e7-7bfd-4239-9c67-4c71968343b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a873a2-58ab-4db5-a1a5-c32942da2928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a873a2-58ab-4db5-a1a5-c32942da2928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-935584105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe15c44b-5ad4-4867-9ce4-fc6ce65611c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2657a8cc48264c26b6ab12586c5549b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:37:54Z,use_quota=True,user_id='233aec230d5a40128214e655f8989805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b9de83-9cfd-4d75-b13b-e033c281bc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b9de83-9cfd-4d75-b13b-e033c281bc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c90a23-9e7e-49f5-b239-423239037393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c90a23-9e7e-49f5-b239-423239037393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe15c44b-5ad4-4867-9ce4-fc6ce65611c5', 'volume_name': 'volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eabca07-cb16-48ac-ad43-3bb875c97665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eabca07-cb16-48ac-ad43-3bb875c97665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90be7085-aae7-4a2a-ad4b-a4f6c7015899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:54 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Volume fe15c44b-5ad4-4867-9ce4-fc6ce65611c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5', 'volume_size': 1} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-935584105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe15c44b-5ad4-4867-9ce4-fc6ce65611c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2657a8cc48264c26b6ab12586c5549b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:37:54Z,use_quota=True,user_id='233aec230d5a40128214e655f8989805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Creating volume fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:37:54 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:37:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:54 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 1073741824 Jun 02 00:37:54 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:55 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3159a9fa-d556-4817-aa2e-99bbdb976785 tempest-VolumesActionsTest-576200696 None] Acquiring lock "cinder-f7c12a27-87ce-4405-8ca7-0d21e615feb0" by "attach_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:37:55 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3159a9fa-d556-4817-aa2e-99bbdb976785 tempest-VolumesActionsTest-576200696 None] Lock "cinder-f7c12a27-87ce-4405-8ca7-0d21e615feb0" acquired by "attach_volume" :: waited 0.039s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:37:55 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-3159a9fa-d556-4817-aa2e-99bbdb976785 tempest-VolumesActionsTest-576200696 None] Attaching volume f7c12a27-87ce-4405-8ca7-0d21e615feb0 to instance dcfc1cab-014e-4b67-afee-d9110284fc52 at mountpoint /dev/vdb on host None. Jun 02 00:37:55 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-3159a9fa-d556-4817-aa2e-99bbdb976785 tempest-VolumesActionsTest-576200696 None] Attach volume completed successfully. Jun 02 00:37:55 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3159a9fa-d556-4817-aa2e-99bbdb976785 tempest-VolumesActionsTest-576200696 None] Lock "cinder-f7c12a27-87ce-4405-8ca7-0d21e615feb0" released by "attach_volume" :: held 0.229s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:37:55 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 1073741824" returned: 0 in 0.904s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:55 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 Jun 02 00:37:55 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:56 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e87859cb-6866-4d3a-8607-faafb0306db0 tempest-VolumesActionsTest-11461469 None] Terminate volume connection completed successfully. Jun 02 00:37:56 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5" returned: 0 in 0.783s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:37:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:37:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90be7085-aae7-4a2a-ad4b-a4f6c7015899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb68b83-7919-408e-9359-cce5d6e4aafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:37:56 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Volume volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 (fe15c44b-5ad4-4867-9ce4-fc6ce65611c5): created successfully Jun 02 00:37:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb68b83-7919-408e-9359-cce5d6e4aafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:37:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Flow 'volume_create_manager' (7dc8e9e7-7bfd-4239-9c67-4c71968343b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:37:56 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-8cd83c9f-756b-4ca2-ab88-247450be0de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Created volume successfully. Jun 02 00:37:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e87859cb-6866-4d3a-8607-faafb0306db0 tempest-VolumesActionsTest-11461469 None] Acquiring lock "cinder-f7c12a27-87ce-4405-8ca7-0d21e615feb0-detach_volume" by "detach_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:37:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e87859cb-6866-4d3a-8607-faafb0306db0 tempest-VolumesActionsTest-11461469 None] Lock "cinder-f7c12a27-87ce-4405-8ca7-0d21e615feb0-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:37:56 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e87859cb-6866-4d3a-8607-faafb0306db0 tempest-VolumesActionsTest-11461469 None] Detaching volume f7c12a27-87ce-4405-8ca7-0d21e615feb0 from instance dcfc1cab-014e-4b67-afee-d9110284fc52. Jun 02 00:37:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:37:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:37:56 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e87859cb-6866-4d3a-8607-faafb0306db0 tempest-VolumesActionsTest-11461469 None] Detach volume completed successfully. Jun 02 00:37:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Creating offline snapshot 54c46deb-0b18-4fc1-8125-64d7521bfed5 of volume fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:37:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e87859cb-6866-4d3a-8607-faafb0306db0 tempest-VolumesActionsTest-11461469 None] Lock "cinder-f7c12a27-87ce-4405-8ca7-0d21e615feb0-detach_volume" released by "detach_volume" :: held 0.235s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:37:57 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[56afe1cc-34d6-42c0-a6ed-4c546a734030]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:37:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:57 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 Jun 02 00:37:57 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e96452c7-6fd1-43af-80d9-35b501fd67ed tempest-VolumesActionsTest-576200696 None] Acquiring lock "cinder-f7c12a27-87ce-4405-8ca7-0d21e615feb0-detach_volume" by "detach_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:37:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e96452c7-6fd1-43af-80d9-35b501fd67ed tempest-VolumesActionsTest-576200696 None] Lock "cinder-f7c12a27-87ce-4405-8ca7-0d21e615feb0-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:37:57 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e96452c7-6fd1-43af-80d9-35b501fd67ed tempest-VolumesActionsTest-576200696 None] Volume detach called, but volume not attached. Jun 02 00:37:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e96452c7-6fd1-43af-80d9-35b501fd67ed tempest-VolumesActionsTest-576200696 None] Lock "cinder-f7c12a27-87ce-4405-8ca7-0d21e615feb0-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:37:57 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5" returned: 0 in 0.848s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:57 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5 1G Jun 02 00:37:57 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:58 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] Acquiring lock "cinder-f7c12a27-87ce-4405-8ca7-0d21e615feb0-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:37:58 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] Lock "cinder-f7c12a27-87ce-4405-8ca7-0d21e615feb0-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:37:58 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] Acquiring lock "cinder-quobyte-f7c12a27-87ce-4405-8ca7-0d21e615feb0" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:37:58 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] Lock "cinder-quobyte-f7c12a27-87ce-4405-8ca7-0d21e615feb0" acquired by "delete_volume" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:37:58 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[4884691d-0757-4996-a34f-86325424dbfc]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:37:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f7c12a27-87ce-4405-8ca7-0d21e615feb0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:58 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f7c12a27-87ce-4405-8ca7-0d21e615feb0 Jun 02 00:37:58 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:58 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-82a55932-7cd8-46f3-8e34-60353ccdf2ff req-7af29ba4-f2c8-4e70-b546-f0b2df216ef1 tempest-AttachVolumeNegativeTest-77772747 None] Terminate volume connection completed successfully. Jun 02 00:37:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-82a55932-7cd8-46f3-8e34-60353ccdf2ff req-7af29ba4-f2c8-4e70-b546-f0b2df216ef1 tempest-AttachVolumeNegativeTest-77772747 None] Deleting attachment d533f0a9-f4a7-4574-98e8-f5ddaceef46c. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:37:58 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5 1G" returned: 0 in 1.102s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:59 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5 Jun 02 00:37:59 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:37:59 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Jun 02 00:37:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f7c12a27-87ce-4405-8ca7-0d21e615feb0" returned: 0 in 0.986s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:37:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f7c12a27-87ce-4405-8ca7-0d21e615feb0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:37:59 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f7c12a27-87ce-4405-8ca7-0d21e615feb0 Jun 02 00:37:59 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:00 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5" returned: 0 in 1.012s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:00 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5 is being set with open permissions: ugo+rw Jun 02 00:38:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:00 devstack sudo[95119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5 Jun 02 00:38:00 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:00 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f7c12a27-87ce-4405-8ca7-0d21e615feb0" returned: 0 in 0.827s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] Lock "cinder-quobyte-f7c12a27-87ce-4405-8ca7-0d21e615feb0" released by "delete_volume" :: held 1.896s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:00 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] Created reservations ['7cf1e389-1adb-4c52-944e-9b2ff5526271', 'd73caa4b-dac2-43bf-9000-7a595ef459ad', 'ef19d5a3-189f-4e6e-bab7-78904e6ccc8f', '3a330e8b-59a5-4991-a697-cb62e25cd0ee'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:38:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:00 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:38:00 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:00 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5" returned: 0 in 0.931s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:01 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.info Jun 02 00:38:01 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:01 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.info" returned: 0 in 0.927s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:01 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.info is being set with open permissions: ugo+rw Jun 02 00:38:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:02 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.331s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:02 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:38:02 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.info Jun 02 00:38:02 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:02 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] Deleted volume successfully. Jun 02 00:38:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d487ed77-7753-4d66-9f55-ff837545239b tempest-VolumesActionsTest-576200696 None] Lock "cinder-f7c12a27-87ce-4405-8ca7-0d21e615feb0-delete_volume" released by "delete_volume" :: held 3.671s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:02 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.info" returned: 0 in 0.902s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.934s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:02 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-961fd940-5295-417f-af52-2f04f0491b87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Create snapshot completed successfully Jun 02 00:38:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Acquiring lock "cinder-54c46deb-0b18-4fc1-8125-64d7521bfed5-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "cinder-54c46deb-0b18-4fc1-8125-64d7521bfed5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Acquiring lock "cinder-quobyte-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "cinder-quobyte-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Acquiring lock "cinder-quobyte-54c46deb-0b18-4fc1-8125-64d7521bfed5" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "cinder-quobyte-54c46deb-0b18-4fc1-8125-64d7521bfed5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:03 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Deleting offline snapshot 54c46deb-0b18-4fc1-8125-64d7521bfed5 of volume fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:38:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] snapshot_file for this snap is: volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:38:04 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e74e811-a82a-4aa1-b715-bb890d5f0e4d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:04 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5 Jun 02 00:38:04 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:05 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5" returned: 0 in 0.954s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:38:05 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e24f204-b03d-456c-80e1-a5262b15dd7c]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:05 devstack sudo[95275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 Jun 02 00:38:05 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:05 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5" returned: 0 in 0.731s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:05 devstack sudo[95280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5 Jun 02 00:38:05 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:06 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5" returned: 0 in 0.664s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:06 devstack sudo[95285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5 Jun 02 00:38:06 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:07 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5.54c46deb-0b18-4fc1-8125-64d7521bfed5" returned: 0 in 0.613s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "cinder-quobyte-54c46deb-0b18-4fc1-8125-64d7521bfed5" released by "_delete_snapshot" :: held 3.122s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "cinder-quobyte-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5" released by "delete_snapshot" :: held 3.145s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:07 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Created reservations ['629708e0-d5eb-41a3-b526-0e367e5ee1a5', '8fbaf880-cf9a-4a5c-adaa-8445d599579d', 'a5a40635-3d4a-4079-b677-b8f9565b3046', '52372b47-424b-489e-803a-1ce0ef5723de'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:38:07 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Delete snapshot completed successfully. Jun 02 00:38:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fe155c5a-9df1-4132-b776-54f29480c33e tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "cinder-54c46deb-0b18-4fc1-8125-64d7521bfed5-delete_snapshot" released by "delete_snapshot" :: held 3.339s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Acquiring lock "cinder-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Flow 'volume_create_manager' (de2b0274-4b71-440f-a320-f2c3df02ebfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0f932c-5729-4dcb-948e-25cbe544c4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "cinder-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0f932c-5729-4dcb-948e-25cbe544c4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1570455137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a130f90-dc33-4bfd-b7a0-9b1375111592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fccf7694c2bc40098c357fff930fc2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:08Z,use_quota=True,user_id='7a433c0692d44abd85716fa4af921426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e8b580-6b53-4739-b522-c5ec30ea5d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e8b580-6b53-4739-b522-c5ec30ea5d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a851738e-5a26-496b-81eb-f9426335687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a851738e-5a26-496b-81eb-f9426335687a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a130f90-dc33-4bfd-b7a0-9b1375111592', 'volume_name': 'volume-1a130f90-dc33-4bfd-b7a0-9b1375111592', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ddd2ac6-2776-4a9d-b941-e65f17e2e7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ddd2ac6-2776-4a9d-b941-e65f17e2e7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264ddbe9-474a-4289-9d59-b56bbb621fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:08 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Volume 1a130f90-dc33-4bfd-b7a0-9b1375111592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a130f90-dc33-4bfd-b7a0-9b1375111592', 'volume_size': 1} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1570455137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a130f90-dc33-4bfd-b7a0-9b1375111592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fccf7694c2bc40098c357fff930fc2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:08Z,use_quota=True,user_id='7a433c0692d44abd85716fa4af921426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Creating volume 1a130f90-dc33-4bfd-b7a0-9b1375111592 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:38:08 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1a130f90-dc33-4bfd-b7a0-9b1375111592 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:08 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1a130f90-dc33-4bfd-b7a0-9b1375111592 1073741824 Jun 02 00:38:08 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Acquiring lock "cinder-quobyte-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "cinder-quobyte-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5" acquired by "delete_volume" :: waited 0.016s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[856c3101-5798-420a-a979-30f9562b40ba]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:08 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 Jun 02 00:38:08 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:09 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1a130f90-dc33-4bfd-b7a0-9b1375111592 1073741824" returned: 0 in 0.776s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:09 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5" returned: 0 in 0.719s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1a130f90-dc33-4bfd-b7a0-9b1375111592 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:09 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5 Jun 02 00:38:09 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:09 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1a130f90-dc33-4bfd-b7a0-9b1375111592 Jun 02 00:38:09 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:09 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5" returned: 0 in 0.702s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:09 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "cinder-quobyte-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5" released by "delete_volume" :: held 1.486s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:09 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1a130f90-dc33-4bfd-b7a0-9b1375111592" returned: 0 in 0.717s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:09 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:38:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:09 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264ddbe9-474a-4289-9d59-b56bbb621fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a130f90-dc33-4bfd-b7a0-9b1375111592', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:09 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16b83be-d9cc-49c8-925b-f33f24b6db48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:09 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Volume volume-1a130f90-dc33-4bfd-b7a0-9b1375111592 (1a130f90-dc33-4bfd-b7a0-9b1375111592): created successfully Jun 02 00:38:09 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16b83be-d9cc-49c8-925b-f33f24b6db48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:09 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Flow 'volume_create_manager' (de2b0274-4b71-440f-a320-f2c3df02ebfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:09 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-9bd65d65-ac63-4546-ae56-65bb004227ab tempest-VolumesActionsTest-576200696 None] Created volume successfully. Jun 02 00:38:09 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Created reservations ['e052a7ee-6627-40b7-8498-a8989860941d', 'dded4390-f7b0-4420-acd2-e23ae0b195d0', 'bebe60ee-ac26-4129-809d-9b9a2bc28b17', '65ce302e-7749-4c74-a5b4-de6d85d80146'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:38:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:10 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:38:10 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "cinder-479824b7-c563-4641-9d89-7e0667c390c0-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] Lock "cinder-479824b7-c563-4641-9d89-7e0667c390c0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "cinder-quobyte-479824b7-c563-4641-9d89-7e0667c390c0" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] Lock "cinder-quobyte-479824b7-c563-4641-9d89-7e0667c390c0" acquired by "delete_volume" :: waited 0.023s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:10 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87368b1-495c-41b6-b1c4-628dd11df590]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-479824b7-c563-4641-9d89-7e0667c390c0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:10 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-479824b7-c563-4641-9d89-7e0667c390c0 Jun 02 00:38:10 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:10 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.672s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:10 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:38:10 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Deleted volume successfully. Jun 02 00:38:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f79f3e4d-ee09-47b8-b9b9-555a195af608 tempest-VolumeSnapshotQuotasNegativeTestJSON-1442439530 None] Lock "cinder-fe15c44b-5ad4-4867-9ce4-fc6ce65611c5-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] Acquiring lock "cinder-1a130f90-dc33-4bfd-b7a0-9b1375111592-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] Lock "cinder-1a130f90-dc33-4bfd-b7a0-9b1375111592-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:11 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] Acquiring lock "cinder-quobyte-1a130f90-dc33-4bfd-b7a0-9b1375111592" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:11 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] Lock "cinder-quobyte-1a130f90-dc33-4bfd-b7a0-9b1375111592" acquired by "delete_volume" :: waited 0.023s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:11 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39db432-f4c9-434d-97fe-8c97f24a5098]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1a130f90-dc33-4bfd-b7a0-9b1375111592 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:11 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:11 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1a130f90-dc33-4bfd-b7a0-9b1375111592 Jun 02 00:38:11 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-479824b7-c563-4641-9d89-7e0667c390c0" returned: 0 in 0.992s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-479824b7-c563-4641-9d89-7e0667c390c0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:11 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-479824b7-c563-4641-9d89-7e0667c390c0 Jun 02 00:38:11 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:11 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1a130f90-dc33-4bfd-b7a0-9b1375111592" returned: 0 in 0.837s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1a130f90-dc33-4bfd-b7a0-9b1375111592 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:11 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1a130f90-dc33-4bfd-b7a0-9b1375111592 Jun 02 00:38:11 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:11 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-479824b7-c563-4641-9d89-7e0667c390c0" returned: 0 in 0.753s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:11 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] Lock "cinder-quobyte-479824b7-c563-4641-9d89-7e0667c390c0" released by "delete_volume" :: held 1.806s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] Created reservations ['d1d8fcf9-553c-4106-aad1-8cee791c0457', 'cd7fbe7a-a77c-4be4-8ba9-d5146a85aa86', '0ceff7c2-e14a-41af-85d0-f99fd4e23522', '9a5af260-f339-4bc5-bf83-7c0be20bf836'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:12 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:38:12 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "cinder-8a41414b-150b-495a-84a9-3ec289082510-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] Lock "cinder-8a41414b-150b-495a-84a9-3ec289082510-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "cinder-quobyte-8a41414b-150b-495a-84a9-3ec289082510" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] Lock "cinder-quobyte-8a41414b-150b-495a-84a9-3ec289082510" acquired by "delete_volume" :: waited 0.027s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b164bdc-1d73-4e65-8b20-8c55d8ee7b05]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8a41414b-150b-495a-84a9-3ec289082510 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:12 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1a130f90-dc33-4bfd-b7a0-9b1375111592" returned: 0 in 0.825s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] Lock "cinder-quobyte-1a130f90-dc33-4bfd-b7a0-9b1375111592" released by "delete_volume" :: held 1.728s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] Created reservations ['00b0d38b-ad6e-46db-9e15-aeb2b3ea250e', '258da78e-c791-4353-bf21-f2bce496280d', '39783ad0-91f7-46db-a517-04576d3df48b', '9ad1d26d-c91e-492c-9c6b-3eead5a61b22'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:38:12 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8a41414b-150b-495a-84a9-3ec289082510 Jun 02 00:38:12 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:12 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:38:12 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:12 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.788s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:38:12 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] Deleted volume successfully. Jun 02 00:38:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36c89b8f-20a2-4859-8aa3-eac60baaae3b tempest-AttachVolumeNegativeTest-77772747 None] Lock "cinder-479824b7-c563-4641-9d89-7e0667c390c0-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:13 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8a41414b-150b-495a-84a9-3ec289082510" returned: 0 in 0.958s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8a41414b-150b-495a-84a9-3ec289082510 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:13 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.727s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:38:13 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] Deleted volume successfully. Jun 02 00:38:13 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8a41414b-150b-495a-84a9-3ec289082510 Jun 02 00:38:13 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e4520cc1-5403-4aff-a42e-b82b718a87ae tempest-VolumesActionsTest-11461469 None] Lock "cinder-1a130f90-dc33-4bfd-b7a0-9b1375111592-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Flow 'volume_create_manager' (a43628ce-70af-4344-92cd-0f0cf21a8446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019014a8-37de-4354-a24c-1a3c33bdd5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019014a8-37de-4354-a24c-1a3c33bdd5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-239126345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbfc30a2-751c-4125-af5e-db350f38e0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fccf7694c2bc40098c357fff930fc2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:14Z,use_quota=True,user_id='7a433c0692d44abd85716fa4af921426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e86706-b115-44e6-821a-3ff2288648c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e86706-b115-44e6-821a-3ff2288648c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94950ff8-f4be-4da9-ac2e-03b55ed58f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94950ff8-f4be-4da9-ac2e-03b55ed58f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbfc30a2-751c-4125-af5e-db350f38e0bf', 'volume_name': 'volume-fbfc30a2-751c-4125-af5e-db350f38e0bf', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f79d10-38e4-464e-8b28-06ce8d0a0577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f79d10-38e4-464e-8b28-06ce8d0a0577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312bbf26-cab0-472c-af27-3e3b6ea89b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:13 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Volume fbfc30a2-751c-4125-af5e-db350f38e0bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbfc30a2-751c-4125-af5e-db350f38e0bf', 'volume_size': 1} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-239126345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbfc30a2-751c-4125-af5e-db350f38e0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fccf7694c2bc40098c357fff930fc2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:14Z,use_quota=True,user_id='7a433c0692d44abd85716fa4af921426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Creating volume fbfc30a2-751c-4125-af5e-db350f38e0bf {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:38:13 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:38:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbfc30a2-751c-4125-af5e-db350f38e0bf 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:13 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbfc30a2-751c-4125-af5e-db350f38e0bf 1073741824 Jun 02 00:38:13 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:14 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8a41414b-150b-495a-84a9-3ec289082510" returned: 0 in 0.711s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] Lock "cinder-quobyte-8a41414b-150b-495a-84a9-3ec289082510" released by "delete_volume" :: held 1.739s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:14 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] Created reservations ['c243ffe9-83b1-4f62-854b-5bc683729485', '380ada14-962f-4a19-8404-0c7b03caf529', '98d602f9-16bf-4aa5-895c-6d01306ff72b', 'a6bf0580-ddad-43d7-9e1a-d14bc0a066d4'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:38:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:14 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:14 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:14 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:38:14 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:14 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbfc30a2-751c-4125-af5e-db350f38e0bf 1073741824" returned: 0 in 0.875s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbfc30a2-751c-4125-af5e-db350f38e0bf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:14 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbfc30a2-751c-4125-af5e-db350f38e0bf Jun 02 00:38:14 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "cinder-6793028c-63f7-4eca-a6ac-0ed2846c9a13-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] Lock "cinder-6793028c-63f7-4eca-a6ac-0ed2846c9a13-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "cinder-quobyte-6793028c-63f7-4eca-a6ac-0ed2846c9a13" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] Lock "cinder-quobyte-6793028c-63f7-4eca-a6ac-0ed2846c9a13" acquired by "delete_volume" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:15 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fdfb44-bf8a-4e61-a69d-44d1a5df128a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:15 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.743s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:38:15 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:15 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] Deleted volume successfully. Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1c064c46-c48a-4266-b5ca-569768c58731 tempest-AttachVolumeNegativeTest-77772747 None] Lock "cinder-8a41414b-150b-495a-84a9-3ec289082510-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:15 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13 Jun 02 00:38:15 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:15 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbfc30a2-751c-4125-af5e-db350f38e0bf" returned: 0 in 0.787s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312bbf26-cab0-472c-af27-3e3b6ea89b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbfc30a2-751c-4125-af5e-db350f38e0bf', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e1c875-bcd9-4f8e-bd2c-c09cea650642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:15 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Volume volume-fbfc30a2-751c-4125-af5e-db350f38e0bf (fbfc30a2-751c-4125-af5e-db350f38e0bf): created successfully Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e1c875-bcd9-4f8e-bd2c-c09cea650642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Flow 'volume_create_manager' (a43628ce-70af-4344-92cd-0f0cf21a8446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:15 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-96814ce1-5cce-44d3-91dc-2ce758d944ee tempest-VolumesActionsTest-576200696 None] Created volume successfully. Jun 02 00:38:15 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.665s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:15 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:38:16 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13" returned: 0 in 0.813s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:16 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13 Jun 02 00:38:16 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] Acquiring lock "cinder-fbfc30a2-751c-4125-af5e-db350f38e0bf-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] Lock "cinder-fbfc30a2-751c-4125-af5e-db350f38e0bf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] Acquiring lock "cinder-quobyte-fbfc30a2-751c-4125-af5e-db350f38e0bf" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] Lock "cinder-quobyte-fbfc30a2-751c-4125-af5e-db350f38e0bf" acquired by "delete_volume" :: waited 0.020s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:16 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee00088-2a28-4c31-9370-16a98875a74b]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbfc30a2-751c-4125-af5e-db350f38e0bf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:16 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbfc30a2-751c-4125-af5e-db350f38e0bf Jun 02 00:38:16 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:16 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6793028c-63f7-4eca-a6ac-0ed2846c9a13" returned: 0 in 0.628s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] Lock "cinder-quobyte-6793028c-63f7-4eca-a6ac-0ed2846c9a13" released by "delete_volume" :: held 1.500s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:16 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] Created reservations ['2697d553-7288-4330-9677-724cfc78b88c', '3830f00c-0678-46f7-9b9a-8d492319fde1', '31039380-af57-428f-b26f-9c2682e5f6a5', 'a87cfc14-cd47-435e-89c2-4d90a81a82f5'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:38:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:16 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:38:16 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:17 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbfc30a2-751c-4125-af5e-db350f38e0bf" returned: 0 in 0.760s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbfc30a2-751c-4125-af5e-db350f38e0bf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:17 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbfc30a2-751c-4125-af5e-db350f38e0bf Jun 02 00:38:17 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:17 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.681s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:17 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:38:17 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] Deleted volume successfully. Jun 02 00:38:17 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-09959928-490a-4e23-849f-38ff0d277ce0 tempest-AttachVolumeNegativeTest-77772747 None] Lock "cinder-6793028c-63f7-4eca-a6ac-0ed2846c9a13-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:17 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbfc30a2-751c-4125-af5e-db350f38e0bf" returned: 0 in 0.704s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:17 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] Lock "cinder-quobyte-fbfc30a2-751c-4125-af5e-db350f38e0bf" released by "delete_volume" :: held 1.522s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:17 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] Created reservations ['d9e41a7c-934c-4dea-b274-dfe4ef141b02', '52c85d9a-97c7-4ed4-8869-f799fc1c61ad', 'aa0021ae-d152-4486-a947-e68b2be8a775', '4818749c-351a-4078-839a-5cf86418c952'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:38:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:17 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:17 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:17 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:38:17 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:18 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.719s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:18 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:38:18 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] Deleted volume successfully. Jun 02 00:38:18 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1fb51312-8637-46ed-a75f-7df9b56b4cab tempest-VolumesActionsTest-11461469 None] Lock "cinder-fbfc30a2-751c-4125-af5e-db350f38e0bf-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:18 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Flow 'volume_create_manager' (083f4543-e8da-418b-8e1d-b593a8b4d19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de80d4a6-53bf-45cd-8cbe-e20fde9a068c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de80d4a6-53bf-45cd-8cbe-e20fde9a068c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1640632050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8403f132-5ad8-42f7-8a34-e15eaf681414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fccf7694c2bc40098c357fff930fc2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:19Z,use_quota=True,user_id='7a433c0692d44abd85716fa4af921426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7befe60-886c-430d-9820-f7073f2cd4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7befe60-886c-430d-9820-f7073f2cd4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1346231-f22b-40b0-b545-79db85bd8d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1346231-f22b-40b0-b545-79db85bd8d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8403f132-5ad8-42f7-8a34-e15eaf681414', 'volume_name': 'volume-8403f132-5ad8-42f7-8a34-e15eaf681414', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fcde5a3-12a7-4754-8df4-b18339fe659d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fcde5a3-12a7-4754-8df4-b18339fe659d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346213e9-b10e-4171-bdac-a2ef5f40cf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:19 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Volume 8403f132-5ad8-42f7-8a34-e15eaf681414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8403f132-5ad8-42f7-8a34-e15eaf681414', 'volume_size': 1} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1640632050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8403f132-5ad8-42f7-8a34-e15eaf681414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fccf7694c2bc40098c357fff930fc2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:19Z,use_quota=True,user_id='7a433c0692d44abd85716fa4af921426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Creating volume 8403f132-5ad8-42f7-8a34-e15eaf681414 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:38:19 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:38:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8403f132-5ad8-42f7-8a34-e15eaf681414 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:19 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8403f132-5ad8-42f7-8a34-e15eaf681414 1073741824 Jun 02 00:38:19 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:20 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8403f132-5ad8-42f7-8a34-e15eaf681414 1073741824" returned: 0 in 0.985s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8403f132-5ad8-42f7-8a34-e15eaf681414 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:20 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8403f132-5ad8-42f7-8a34-e15eaf681414 Jun 02 00:38:20 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:20 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8403f132-5ad8-42f7-8a34-e15eaf681414" returned: 0 in 0.785s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:20 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:38:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346213e9-b10e-4171-bdac-a2ef5f40cf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8403f132-5ad8-42f7-8a34-e15eaf681414', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf107c9-3385-4fa7-88ea-8ccdd34812fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:20 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Volume volume-8403f132-5ad8-42f7-8a34-e15eaf681414 (8403f132-5ad8-42f7-8a34-e15eaf681414): created successfully Jun 02 00:38:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf107c9-3385-4fa7-88ea-8ccdd34812fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Flow 'volume_create_manager' (083f4543-e8da-418b-8e1d-b593a8b4d19b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:20 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-59ed13dc-04eb-416b-9617-3f47e6dc26cb tempest-VolumesActionsTest-576200696 None] Created volume successfully. Jun 02 00:38:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] Acquiring lock "cinder-8403f132-5ad8-42f7-8a34-e15eaf681414-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] Lock "cinder-8403f132-5ad8-42f7-8a34-e15eaf681414-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] Acquiring lock "cinder-quobyte-8403f132-5ad8-42f7-8a34-e15eaf681414" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] Lock "cinder-quobyte-8403f132-5ad8-42f7-8a34-e15eaf681414" acquired by "delete_volume" :: waited 0.023s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:21 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2148348c-cb11-4558-8a68-9dfb0094531a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8403f132-5ad8-42f7-8a34-e15eaf681414 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:21 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8403f132-5ad8-42f7-8a34-e15eaf681414 Jun 02 00:38:21 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:21 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Flow 'volume_create_manager' (fa8fed1d-98c6-459f-8924-6d839def832b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d8b1ab-577c-496f-b7ca-64854707fa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d8b1ab-577c-496f-b7ca-64854707fa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1554233118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936d57de-d325-4c86-a634-4ecdce9707e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a170209ded4d44a6ad3a7ed3703aede1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:22Z,use_quota=True,user_id='ddfa9a812edc4e52a2adc5e39ebade21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d897f91-97c0-4b6e-b672-5cfd29c6455c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d897f91-97c0-4b6e-b672-5cfd29c6455c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5277d50-6006-4738-a2ea-9251919862fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5277d50-6006-4738-a2ea-9251919862fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '936d57de-d325-4c86-a634-4ecdce9707e9', 'volume_name': 'volume-936d57de-d325-4c86-a634-4ecdce9707e9', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0298f1c3-7435-4a7f-94c2-094d6d38aaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0298f1c3-7435-4a7f-94c2-094d6d38aaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9297ed-ca74-4319-9711-90b2228802d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:22 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Volume 936d57de-d325-4c86-a634-4ecdce9707e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-936d57de-d325-4c86-a634-4ecdce9707e9', 'volume_size': 1} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1554233118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936d57de-d325-4c86-a634-4ecdce9707e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a170209ded4d44a6ad3a7ed3703aede1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:22Z,use_quota=True,user_id='ddfa9a812edc4e52a2adc5e39ebade21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Creating volume 936d57de-d325-4c86-a634-4ecdce9707e9 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:38:22 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:22 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9 1073741824 Jun 02 00:38:22 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:22 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8403f132-5ad8-42f7-8a34-e15eaf681414" returned: 0 in 0.983s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8403f132-5ad8-42f7-8a34-e15eaf681414 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:22 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8403f132-5ad8-42f7-8a34-e15eaf681414 Jun 02 00:38:22 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:22 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9 1073741824" returned: 0 in 0.863s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:23 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9 Jun 02 00:38:23 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:23 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8403f132-5ad8-42f7-8a34-e15eaf681414" returned: 0 in 0.660s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] Lock "cinder-quobyte-8403f132-5ad8-42f7-8a34-e15eaf681414" released by "delete_volume" :: held 1.721s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] Created reservations ['ba48728f-a7a0-4d06-a226-1a4517da5aab', '3031828b-f219-4a59-93ad-1e48e79f2e95', 'e8a0ce68-1bbd-4b8f-b06a-0a702087f13b', 'fc528075-974b-4066-bba7-ed5c5fa19ea3'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:23 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:38:23 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:23 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-3a0a13c0-f668-410f-b624-7d6e8ee85fba req-414e6754-6b2e-4b22-8522-3b2891eb508a tempest-AttachVolumeShelveTestJSON-425694257 None] Terminate volume connection completed successfully. Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-3a0a13c0-f668-410f-b624-7d6e8ee85fba req-414e6754-6b2e-4b22-8522-3b2891eb508a tempest-AttachVolumeShelveTestJSON-425694257 None] Deleting attachment 4f6d17a2-8a95-4b4b-b625-b4ab8ff9d7c7. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:38:23 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9" returned: 0 in 0.768s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9297ed-ca74-4319-9711-90b2228802d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-936d57de-d325-4c86-a634-4ecdce9707e9', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad1b0c1-43e8-4938-8c27-39e703189327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:23 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Volume volume-936d57de-d325-4c86-a634-4ecdce9707e9 (936d57de-d325-4c86-a634-4ecdce9707e9): created successfully Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad1b0c1-43e8-4938-8c27-39e703189327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Flow 'volume_create_manager' (fa8fed1d-98c6-459f-8924-6d839def832b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:23 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-12410dfb-edc0-4df9-9172-3ad99932b08d tempest-SnapshotMetadataTestJSON-1148803421 None] Created volume successfully. Jun 02 00:38:24 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.794s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:38:24 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] Deleted volume successfully. Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Flow 'volume_create_manager' (f6f26f2b-23d9-42eb-9b2c-148e9d953c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea19f0e6-8434-4dff-9187-264c9ee45314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea19f0e6-8434-4dff-9187-264c9ee45314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2045256857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b038309-0ded-4710-b3a3-3a39c1eb6b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fccf7694c2bc40098c357fff930fc2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:24Z,use_quota=True,user_id='7a433c0692d44abd85716fa4af921426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991d3944-cf21-424b-b92a-9c21b5ec4046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991d3944-cf21-424b-b92a-9c21b5ec4046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9714031f-bdaf-49b8-8c64-bcc55c79ae9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9714031f-bdaf-49b8-8c64-bcc55c79ae9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b038309-0ded-4710-b3a3-3a39c1eb6b5b', 'volume_name': 'volume-7b038309-0ded-4710-b3a3-3a39c1eb6b5b', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5587e1eb-e189-4ad2-abdc-dfa21aa11c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5587e1eb-e189-4ad2-abdc-dfa21aa11c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e1b1b2-77cb-442e-93ad-cd0c00b738e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:24 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Volume 7b038309-0ded-4710-b3a3-3a39c1eb6b5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b038309-0ded-4710-b3a3-3a39c1eb6b5b', 'volume_size': 1} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2045256857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b038309-0ded-4710-b3a3-3a39c1eb6b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fccf7694c2bc40098c357fff930fc2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:24Z,use_quota=True,user_id='7a433c0692d44abd85716fa4af921426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Creating volume 7b038309-0ded-4710-b3a3-3a39c1eb6b5b {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:38:24 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b038309-0ded-4710-b3a3-3a39c1eb6b5b 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f5a72ab2-1801-485d-b9c4-9b0c3796d071 tempest-VolumesActionsTest-11461469 None] Lock "cinder-8403f132-5ad8-42f7-8a34-e15eaf681414-delete_volume" released by "delete_volume" :: held 2.930s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:24 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b038309-0ded-4710-b3a3-3a39c1eb6b5b 1073741824 Jun 02 00:38:24 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:25 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b038309-0ded-4710-b3a3-3a39c1eb6b5b 1073741824" returned: 0 in 0.850s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b038309-0ded-4710-b3a3-3a39c1eb6b5b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:38:25 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b038309-0ded-4710-b3a3-3a39c1eb6b5b Jun 02 00:38:25 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Flow 'volume_create_manager' (ef613e18-026b-461b-a466-3cf6d666f521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86252c40-c9ad-4cf5-ab61-0020fc7ad0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86252c40-c9ad-4cf5-ab61-0020fc7ad0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1658912948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fc7521-3b7f-4d6a-9978-2dff067a2824,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7617dbaceacb4e789cb32e3f570a3622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:25Z,use_quota=True,user_id='1330b1dc398d4a819865255b42fec86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be2c743b-33bb-49b6-9019-87763a874fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be2c743b-33bb-49b6-9019-87763a874fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3924ce-10ac-4718-b3b2-ca63ca5d7c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3924ce-10ac-4718-b3b2-ca63ca5d7c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95fc7521-3b7f-4d6a-9978-2dff067a2824', 'volume_name': 'volume-95fc7521-3b7f-4d6a-9978-2dff067a2824', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4ecee1-f05b-4658-a564-016acac77606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4ecee1-f05b-4658-a564-016acac77606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b7ed75-50fb-451b-9be0-d69bd51c0fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:25 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Volume 95fc7521-3b7f-4d6a-9978-2dff067a2824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95fc7521-3b7f-4d6a-9978-2dff067a2824', 'volume_size': 1} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:25 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b038309-0ded-4710-b3a3-3a39c1eb6b5b" returned: 0 in 0.603s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.328s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] Creating offline snapshot 31541170-f31f-47fe-9fc5-14ceb97ba6b6 of volume 936d57de-d325-4c86-a634-4ecdce9707e9 {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e1b1b2-77cb-442e-93ad-cd0c00b738e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b038309-0ded-4710-b3a3-3a39c1eb6b5b', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db4d8db-9b8c-4339-8119-9729a1453873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05e944a-b452-4c8d-90ff-77bf5185f70d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:25 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Volume volume-7b038309-0ded-4710-b3a3-3a39c1eb6b5b (7b038309-0ded-4710-b3a3-3a39c1eb6b5b): created successfully Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db4d8db-9b8c-4339-8119-9729a1453873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Flow 'volume_create_manager' (f6f26f2b-23d9-42eb-9b2c-148e9d953c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:25 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-718dfedb-c825-4adc-99cd-d77013c671fc tempest-VolumesActionsTest-576200696 None] Created volume successfully. Jun 02 00:38:25 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9 Jun 02 00:38:25 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] Acquiring lock "cinder-7b038309-0ded-4710-b3a3-3a39c1eb6b5b-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] Lock "cinder-7b038309-0ded-4710-b3a3-3a39c1eb6b5b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] Acquiring lock "cinder-quobyte-7b038309-0ded-4710-b3a3-3a39c1eb6b5b" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] Lock "cinder-quobyte-7b038309-0ded-4710-b3a3-3a39c1eb6b5b" acquired by "delete_volume" :: waited 0.014s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:26 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d941fe-9aa0-41a0-8758-8f18ead22fc1]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b038309-0ded-4710-b3a3-3a39c1eb6b5b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:26 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9" returned: 0 in 0.753s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:26 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b038309-0ded-4710-b3a3-3a39c1eb6b5b Jun 02 00:38:26 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:26 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6 1G Jun 02 00:38:26 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:27 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b038309-0ded-4710-b3a3-3a39c1eb6b5b" returned: 0 in 0.956s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b038309-0ded-4710-b3a3-3a39c1eb6b5b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:27 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b038309-0ded-4710-b3a3-3a39c1eb6b5b Jun 02 00:38:27 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:27 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6 1G" returned: 0 in 0.968s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-936d57de-d325-4c86-a634-4ecdce9707e9 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:27 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-936d57de-d325-4c86-a634-4ecdce9707e9 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6 Jun 02 00:38:27 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:28 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b038309-0ded-4710-b3a3-3a39c1eb6b5b" returned: 0 in 0.636s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] Lock "cinder-quobyte-7b038309-0ded-4710-b3a3-3a39c1eb6b5b" released by "delete_volume" :: held 1.646s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:28 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] Created reservations ['2b586429-1963-4b4e-bf4d-ea349e61d679', '5a3d3d61-a8fe-418b-a30b-752dfec6b5e1', 'ef77258a-a98f-47b2-82b3-591dfe8d66c1', '38a25199-4fac-4f04-b6e8-86a44f58074a'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:38:28 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-936d57de-d325-4c86-a634-4ecdce9707e9 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6" returned: 0 in 0.680s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:28 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6 is being set with open permissions: ugo+rw Jun 02 00:38:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:28 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6 Jun 02 00:38:28 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:28 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:38:28 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:28 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6" returned: 0 in 0.720s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:28 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.736s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:28 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:38:28 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] Deleted volume successfully. Jun 02 00:38:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:29 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.info Jun 02 00:38:29 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c6b367e5-4324-4ec4-8159-800e280e4c67 tempest-VolumesActionsTest-11461469 None] Lock "cinder-7b038309-0ded-4710-b3a3-3a39c1eb6b5b-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:29 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:38:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Flow 'volume_create_manager' (e1fd02cb-9b6f-4463-964f-83a9cf189412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2798ae-b1d8-430d-913b-59932cca0ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2798ae-b1d8-430d-913b-59932cca0ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-119709843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9ac991-848a-437a-9c55-a6e64319074b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fccf7694c2bc40098c357fff930fc2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:29Z,use_quota=True,user_id='7a433c0692d44abd85716fa4af921426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd9417f-5813-42ad-9337-957628e046c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd9417f-5813-42ad-9337-957628e046c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62295e09-4efc-4bf9-bffd-a780ea5f88ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62295e09-4efc-4bf9-bffd-a780ea5f88ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9ac991-848a-437a-9c55-a6e64319074b', 'volume_name': 'volume-9c9ac991-848a-437a-9c55-a6e64319074b', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04cc30d-3063-4e85-bc30-404c8c09b9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04cc30d-3063-4e85-bc30-404c8c09b9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38a65bf-2598-48f0-949c-fcb54d17c54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:29 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Volume 9c9ac991-848a-437a-9c55-a6e64319074b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9ac991-848a-437a-9c55-a6e64319074b', 'volume_size': 1} Jun 02 00:38:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:29 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.info" returned: 0 in 0.644s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:29 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.info is being set with open permissions: ugo+rw Jun 02 00:38:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:29 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.info Jun 02 00:38:29 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:30 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.info" returned: 0 in 0.593s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.481s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1658912948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fc7521-3b7f-4d6a-9978-2dff067a2824,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7617dbaceacb4e789cb32e3f570a3622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:25Z,use_quota=True,user_id='1330b1dc398d4a819865255b42fec86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:38:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Creating volume 95fc7521-3b7f-4d6a-9978-2dff067a2824 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:38:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:38:30 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:38:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-95fc7521-3b7f-4d6a-9978-2dff067a2824 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:30 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-95fc7521-3b7f-4d6a-9978-2dff067a2824 1073741824 Jun 02 00:38:30 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:30 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-686c0f9d-f28c-4384-973f-78f6042ef8e2 tempest-SnapshotMetadataTestJSON-1148803421 None] Create snapshot completed successfully Jun 02 00:38:31 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-95fc7521-3b7f-4d6a-9978-2dff067a2824 1073741824" returned: 0 in 0.827s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-95fc7521-3b7f-4d6a-9978-2dff067a2824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:31 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-95fc7521-3b7f-4d6a-9978-2dff067a2824 Jun 02 00:38:31 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] Acquiring lock "cinder-31541170-f31f-47fe-9fc5-14ceb97ba6b6-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "cinder-31541170-f31f-47fe-9fc5-14ceb97ba6b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] Acquiring lock "cinder-quobyte-936d57de-d325-4c86-a634-4ecdce9707e9" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "cinder-quobyte-936d57de-d325-4c86-a634-4ecdce9707e9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] Acquiring lock "cinder-quobyte-31541170-f31f-47fe-9fc5-14ceb97ba6b6" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "cinder-quobyte-31541170-f31f-47fe-9fc5-14ceb97ba6b6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] Deleting offline snapshot 31541170-f31f-47fe-9fc5-14ceb97ba6b6 of volume 936d57de-d325-4c86-a634-4ecdce9707e9 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] snapshot_file for this snap is: volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a854986-8dc0-4bb7-b621-feb4a40f9437]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:31 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-95fc7521-3b7f-4d6a-9978-2dff067a2824" returned: 0 in 0.633s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.463s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-119709843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9ac991-848a-437a-9c55-a6e64319074b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fccf7694c2bc40098c357fff930fc2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:29Z,use_quota=True,user_id='7a433c0692d44abd85716fa4af921426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Creating volume 9c9ac991-848a-437a-9c55-a6e64319074b {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:38:31 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c9ac991-848a-437a-9c55-a6e64319074b 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:31 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c9ac991-848a-437a-9c55-a6e64319074b 1073741824 Jun 02 00:38:31 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b7ed75-50fb-451b-9be0-d69bd51c0fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95fc7521-3b7f-4d6a-9978-2dff067a2824', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58517ca4-799e-42df-a0de-2ca391492425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:31 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6 Jun 02 00:38:31 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:31 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Volume volume-95fc7521-3b7f-4d6a-9978-2dff067a2824 (95fc7521-3b7f-4d6a-9978-2dff067a2824): created successfully Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58517ca4-799e-42df-a0de-2ca391492425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Flow 'volume_create_manager' (ef613e18-026b-461b-a466-3cf6d666f521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:31 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-79555b34-29e9-464d-bf3b-e9db18c70fee tempest-VolumesTestJSON-1678906826 None] Created volume successfully. Jun 02 00:38:32 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6" returned: 0 in 0.739s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:32 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-936d57de-d325-4c86-a634-4ecdce9707e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:38:32 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3eaf1e4-9162-4e6b-a6d0-9e08277861e4]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:32 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c9ac991-848a-437a-9c55-a6e64319074b 1073741824" returned: 0 in 0.792s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c9ac991-848a-437a-9c55-a6e64319074b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:32 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9 Jun 02 00:38:32 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:32 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c9ac991-848a-437a-9c55-a6e64319074b Jun 02 00:38:32 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Flow 'volume_create_manager' (147bf243-91db-4b41-92e8-084a6d832164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71be46f4-f05f-4264-a5fc-54d2044183f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71be46f4-f05f-4264-a5fc-54d2044183f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-61468275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d883e6c-08b5-475b-ab4c-fc59d4b0e5db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7617dbaceacb4e789cb32e3f570a3622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:33Z,use_quota=True,user_id='1330b1dc398d4a819865255b42fec86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0db688-b863-4933-807a-7443ea7ae499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0db688-b863-4933-807a-7443ea7ae499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f070a0df-f993-4030-b36e-5bebe44583f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f070a0df-f993-4030-b36e-5bebe44583f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d883e6c-08b5-475b-ab4c-fc59d4b0e5db', 'volume_name': 'volume-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9575f9-bb8a-427d-aeb7-25b2b17c13e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9575f9-bb8a-427d-aeb7-25b2b17c13e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314cc9b5-4ec9-4123-9ce8-bd63a04f442c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:33 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Volume 1d883e6c-08b5-475b-ab4c-fc59d4b0e5db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db', 'volume_size': 1} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:33 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c9ac991-848a-437a-9c55-a6e64319074b" returned: 0 in 0.677s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:38:33 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.094s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-61468275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d883e6c-08b5-475b-ab4c-fc59d4b0e5db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7617dbaceacb4e789cb32e3f570a3622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:33Z,use_quota=True,user_id='1330b1dc398d4a819865255b42fec86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Creating volume 1d883e6c-08b5-475b-ab4c-fc59d4b0e5db {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:38:33 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9" returned: 0 in 0.817s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:33 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db 1073741824 Jun 02 00:38:33 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38a65bf-2598-48f0-949c-fcb54d17c54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9ac991-848a-437a-9c55-a6e64319074b', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c158c7c-64e6-43de-b3b7-3fea98406d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:33 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6 Jun 02 00:38:33 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:33 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Volume volume-9c9ac991-848a-437a-9c55-a6e64319074b (9c9ac991-848a-437a-9c55-a6e64319074b): created successfully Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c158c7c-64e6-43de-b3b7-3fea98406d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Flow 'volume_create_manager' (e1fd02cb-9b6f-4463-964f-83a9cf189412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:33 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-13d3433e-2453-4d8f-aa2b-a0983704173a tempest-VolumesActionsTest-576200696 None] Created volume successfully. Jun 02 00:38:34 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6" returned: 0 in 0.792s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:34 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6 Jun 02 00:38:34 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:34 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db 1073741824" returned: 0 in 0.881s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:34 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=130,cinder:SELECT=101,cinder:INSERT=33,cinder:DELETE=11 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:38:34 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=102,cinder:UPDATE=126,cinder:INSERT=26,cinder:DELETE=12 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:38:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:34 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db Jun 02 00:38:34 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:34 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9.31541170-f31f-47fe-9fc5-14ceb97ba6b6" returned: 0 in 0.712s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "cinder-quobyte-31541170-f31f-47fe-9fc5-14ceb97ba6b6" released by "_delete_snapshot" :: held 3.208s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "cinder-quobyte-936d57de-d325-4c86-a634-4ecdce9707e9" released by "delete_snapshot" :: held 3.233s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:34 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] Created reservations ['167a7736-cb3a-4c04-89e8-20da7e2ee008', 'dabd8c3d-1232-40f9-9feb-c6cc7f45097a', 'c03460c1-692d-43d8-b0e3-1999f4aa1ad7', '2d07ca7b-05ad-4995-a440-39d177527d4a'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:38:34 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db" returned: 0 in 0.791s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:34 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:38:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314cc9b5-4ec9-4123-9ce8-bd63a04f442c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2989a7b3-7847-407b-b75b-bb274e4f307e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:35 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] Delete snapshot completed successfully. Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-59976d78-a59c-44c9-9412-bc5f03ef701c tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "cinder-31541170-f31f-47fe-9fc5-14ceb97ba6b6-delete_snapshot" released by "delete_snapshot" :: held 3.435s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:35 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Volume volume-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db (1d883e6c-08b5-475b-ab4c-fc59d4b0e5db): created successfully Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2989a7b3-7847-407b-b75b-bb274e4f307e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Flow 'volume_create_manager' (147bf243-91db-4b41-92e8-084a6d832164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:35 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-c825cf27-a825-4190-8f11-94b52ccaa813 tempest-VolumesTestJSON-1678906826 None] Created volume successfully. Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] Acquiring lock "cinder-9c9ac991-848a-437a-9c55-a6e64319074b-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] Lock "cinder-9c9ac991-848a-437a-9c55-a6e64319074b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] Acquiring lock "cinder-quobyte-9c9ac991-848a-437a-9c55-a6e64319074b" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] Lock "cinder-quobyte-9c9ac991-848a-437a-9c55-a6e64319074b" acquired by "delete_volume" :: waited 0.022s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb92fb7-469e-47dd-afc8-9d3862ab6088]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c9ac991-848a-437a-9c55-a6e64319074b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:35 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c9ac991-848a-437a-9c55-a6e64319074b Jun 02 00:38:35 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Flow 'volume_create_manager' (27d3c3c0-b997-4caa-951a-3da586d30595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799082f3-e659-4414-af56-7832d8c95237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799082f3-e659-4414-af56-7832d8c95237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1637674926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9f44b1-cec5-4a85-a1aa-5465dc24230a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7617dbaceacb4e789cb32e3f570a3622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:36Z,use_quota=True,user_id='1330b1dc398d4a819865255b42fec86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b2e6cf-9483-4b0f-8d7f-d94f8cb4c8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b2e6cf-9483-4b0f-8d7f-d94f8cb4c8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd90d2a-9358-474f-9a96-f4998a4cb36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd90d2a-9358-474f-9a96-f4998a4cb36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f9f44b1-cec5-4a85-a1aa-5465dc24230a', 'volume_name': 'volume-9f9f44b1-cec5-4a85-a1aa-5465dc24230a', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85cd59a-f73a-42f2-8109-93b4aee52f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85cd59a-f73a-42f2-8109-93b4aee52f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c644001-a310-4494-ac23-e4d8f4ccebf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:35 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Volume 9f9f44b1-cec5-4a85-a1aa-5465dc24230a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f9f44b1-cec5-4a85-a1aa-5465dc24230a', 'volume_size': 1} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1637674926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9f44b1-cec5-4a85-a1aa-5465dc24230a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7617dbaceacb4e789cb32e3f570a3622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:36Z,use_quota=True,user_id='1330b1dc398d4a819865255b42fec86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Creating volume 9f9f44b1-cec5-4a85-a1aa-5465dc24230a {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:38:35 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9f9f44b1-cec5-4a85-a1aa-5465dc24230a 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:35 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9f9f44b1-cec5-4a85-a1aa-5465dc24230a 1073741824 Jun 02 00:38:35 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] Acquiring lock "cinder-936d57de-d325-4c86-a634-4ecdce9707e9-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "cinder-936d57de-d325-4c86-a634-4ecdce9707e9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] Acquiring lock "cinder-quobyte-936d57de-d325-4c86-a634-4ecdce9707e9" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "cinder-quobyte-936d57de-d325-4c86-a634-4ecdce9707e9" acquired by "delete_volume" :: waited 0.037s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:36 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe3d3e0-beff-4efc-8527-e7a6021eeb4e]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:36 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9 Jun 02 00:38:36 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:36 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c9ac991-848a-437a-9c55-a6e64319074b" returned: 0 in 0.844s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c9ac991-848a-437a-9c55-a6e64319074b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:36 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c9ac991-848a-437a-9c55-a6e64319074b Jun 02 00:38:36 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:36 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9f9f44b1-cec5-4a85-a1aa-5465dc24230a 1073741824" returned: 0 in 0.850s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9f9f44b1-cec5-4a85-a1aa-5465dc24230a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:36 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9f9f44b1-cec5-4a85-a1aa-5465dc24230a Jun 02 00:38:36 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:36 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9" returned: 0 in 0.881s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:37 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9 Jun 02 00:38:37 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:37 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c9ac991-848a-437a-9c55-a6e64319074b" returned: 0 in 0.756s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] Lock "cinder-quobyte-9c9ac991-848a-437a-9c55-a6e64319074b" released by "delete_volume" :: held 1.661s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] Created reservations ['079e5819-9808-4bbf-a2a5-cfb1933fbe24', '22e7df13-b9e9-4b7e-9be2-122a27e6c762', '68da2948-e2af-4b69-bffc-379d89019192', 'cc7df56e-fa8f-46ce-8046-e647ff358634'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:37 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:38:37 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:37 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9f9f44b1-cec5-4a85-a1aa-5465dc24230a" returned: 0 in 0.706s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c644001-a310-4494-ac23-e4d8f4ccebf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9f44b1-cec5-4a85-a1aa-5465dc24230a', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf296c17-15dc-41e4-b5bb-2953fcd0bf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:37 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Volume volume-9f9f44b1-cec5-4a85-a1aa-5465dc24230a (9f9f44b1-cec5-4a85-a1aa-5465dc24230a): created successfully Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf296c17-15dc-41e4-b5bb-2953fcd0bf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Flow 'volume_create_manager' (27d3c3c0-b997-4caa-951a-3da586d30595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:37 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-32c37b8f-35c7-4422-b0d2-8431cdbcc9d8 tempest-VolumesTestJSON-1678906826 None] Created volume successfully. Jun 02 00:38:37 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-936d57de-d325-4c86-a634-4ecdce9707e9" returned: 0 in 0.757s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "cinder-quobyte-936d57de-d325-4c86-a634-4ecdce9707e9" released by "delete_volume" :: held 1.706s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] Created reservations ['508f1b26-2003-40d4-be7e-71eef9b5afe9', '3a7c3952-5fe8-41d1-8f21-d4e75519e427', '460433e2-c45d-4983-9d7c-38486fe3daba', '03cbeb5c-92b1-47bd-a17c-cdfb7aa03cf8'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:37 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:38:37 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:38 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.843s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:38 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:38:38 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] Deleted volume successfully. Jun 02 00:38:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9898cb9b-0817-462b-897b-7ca150b8b3e0 tempest-VolumesActionsTest-576200696 None] Lock "cinder-9c9ac991-848a-437a-9c55-a6e64319074b-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:38 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.870s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:38 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:38:38 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] Deleted volume successfully. Jun 02 00:38:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e198d8af-aa3c-437d-9a4f-3d697896944e tempest-SnapshotMetadataTestJSON-1148803421 None] Lock "cinder-936d57de-d325-4c86-a634-4ecdce9707e9-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] Acquiring lock "cinder-9f9f44b1-cec5-4a85-a1aa-5465dc24230a-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] Lock "cinder-9f9f44b1-cec5-4a85-a1aa-5465dc24230a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] Acquiring lock "cinder-quobyte-9f9f44b1-cec5-4a85-a1aa-5465dc24230a" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] Lock "cinder-quobyte-9f9f44b1-cec5-4a85-a1aa-5465dc24230a" acquired by "delete_volume" :: waited 0.020s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:39 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c26be8-b21c-46b3-9a1e-ad7b4e500b5f]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9f9f44b1-cec5-4a85-a1aa-5465dc24230a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:39 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9f9f44b1-cec5-4a85-a1aa-5465dc24230a Jun 02 00:38:39 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:40 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9f9f44b1-cec5-4a85-a1aa-5465dc24230a" returned: 0 in 0.786s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9f9f44b1-cec5-4a85-a1aa-5465dc24230a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:40 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9f9f44b1-cec5-4a85-a1aa-5465dc24230a Jun 02 00:38:40 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:40 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9f9f44b1-cec5-4a85-a1aa-5465dc24230a" returned: 0 in 0.678s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] Lock "cinder-quobyte-9f9f44b1-cec5-4a85-a1aa-5465dc24230a" released by "delete_volume" :: held 1.515s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:40 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] Created reservations ['c6ec46fc-4778-484f-84b9-53857b2aadbd', '96bd841f-69ad-4625-aba4-6bab89c76929', '1ee744d7-61b9-4b9a-b3a3-5d5c4c56975f', '3069acfb-f7d3-452b-a674-aa95ae3e9eb1'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:38:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:40 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:38:40 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] Acquiring lock "cinder-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] Lock "cinder-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Flow 'volume_create_manager' (2143cf6b-2cda-4231-a757-49914dbb1563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f613929d-9b95-4555-bd9d-0a51bce2ac5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f613929d-9b95-4555-bd9d-0a51bce2ac5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-462365502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b7257f-63e2-483d-a684-18a7a96936bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fcea00b006247fcbd36a2c92c619787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:41Z,use_quota=True,user_id='dd1053f3fe264778a7b083a867f57ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95d01a9-7031-4f14-8e18-30c7dd3e2020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95d01a9-7031-4f14-8e18-30c7dd3e2020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f8a368-a98a-4351-bec6-45aaa20c8d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f8a368-a98a-4351-bec6-45aaa20c8d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b7257f-63e2-483d-a684-18a7a96936bc', 'volume_name': 'volume-48b7257f-63e2-483d-a684-18a7a96936bc', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a950c630-d312-4929-9a3c-5fc860137a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:41 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a950c630-d312-4929-9a3c-5fc860137a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9a18c3-6115-4dc2-8dde-1d0d635b21c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:41 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Volume 48b7257f-63e2-483d-a684-18a7a96936bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b7257f-63e2-483d-a684-18a7a96936bc', 'volume_size': 1} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-462365502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b7257f-63e2-483d-a684-18a7a96936bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fcea00b006247fcbd36a2c92c619787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:41Z,use_quota=True,user_id='dd1053f3fe264778a7b083a867f57ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Creating volume 48b7257f-63e2-483d-a684-18a7a96936bc {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:38:41 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.784s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:38:41 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc 1073741824 Jun 02 00:38:41 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:41 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] Deleted volume successfully. Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] Acquiring lock "cinder-quobyte-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] Lock "cinder-quobyte-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-067275b6-eb7e-4f93-8422-ccd611e125b5 tempest-VolumesTestJSON-1678906826 None] Lock "cinder-9f9f44b1-cec5-4a85-a1aa-5465dc24230a-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee7ecd0-7949-4730-8e70-9cffb2fa50fa]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:41 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db Jun 02 00:38:41 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:42 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db" returned: 0 in 0.929s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:42 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db Jun 02 00:38:42 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:42 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc 1073741824" returned: 0 in 1.220s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:42 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc Jun 02 00:38:42 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:43 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db" returned: 0 in 0.960s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] Lock "cinder-quobyte-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db" released by "delete_volume" :: held 1.949s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:43 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] Created reservations ['2741c5bc-8198-46d8-9a30-580ebb106e4a', '05aa35ad-7074-4a9b-a6fb-e4e083119d96', '20ef6b85-5adc-4786-ad46-ab238ca84b3f', '8923873b-e029-4402-ba8b-58d5ea9550e5'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:38:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:43 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc" returned: 0 in 0.971s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] <== create_volume: return (2266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:38:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.269s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:43 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:38:43 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9a18c3-6115-4dc2-8dde-1d0d635b21c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b7257f-63e2-483d-a684-18a7a96936bc', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00213c2d-44a5-4692-8588-76165dd48347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:43 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Volume volume-48b7257f-63e2-483d-a684-18a7a96936bc (48b7257f-63e2-483d-a684-18a7a96936bc): created successfully Jun 02 00:38:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00213c2d-44a5-4692-8588-76165dd48347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Flow 'volume_create_manager' (2143cf6b-2cda-4231-a757-49914dbb1563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:43 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-50c440c4-a293-420a-946b-64553186831d tempest-VolumesDeleteCascade-1875024950 None] Created volume successfully. Jun 02 00:38:44 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.658s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:44 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:38:44 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] Deleted volume successfully. Jun 02 00:38:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0dbb4441-2a9a-4590-a772-9c472bd911c1 tempest-VolumesTestJSON-1678906826 None] Lock "cinder-1d883e6c-08b5-475b-ab4c-fc59d4b0e5db-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] Acquiring lock "cinder-95fc7521-3b7f-4d6a-9978-2dff067a2824-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] Lock "cinder-95fc7521-3b7f-4d6a-9978-2dff067a2824-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] Acquiring lock "cinder-quobyte-95fc7521-3b7f-4d6a-9978-2dff067a2824" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] Lock "cinder-quobyte-95fc7521-3b7f-4d6a-9978-2dff067a2824" acquired by "delete_volume" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:45 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[17466a06-529f-4de5-8130-acc9e716771f]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-95fc7521-3b7f-4d6a-9978-2dff067a2824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] Creating offline snapshot ea51e32f-39a7-45ee-9c73-2ccf414093cf of volume 48b7257f-63e2-483d-a684-18a7a96936bc {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:38:45 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3b1de5-765c-4d5c-b8b6-2ef80027c254]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:45 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-95fc7521-3b7f-4d6a-9978-2dff067a2824 Jun 02 00:38:45 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:45 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc Jun 02 00:38:45 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:45 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-95fc7521-3b7f-4d6a-9978-2dff067a2824" returned: 0 in 0.862s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-95fc7521-3b7f-4d6a-9978-2dff067a2824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:46 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-95fc7521-3b7f-4d6a-9978-2dff067a2824 Jun 02 00:38:46 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:46 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc" returned: 0 in 0.816s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:46 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf 1G Jun 02 00:38:46 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:46 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-95fc7521-3b7f-4d6a-9978-2dff067a2824" returned: 0 in 0.746s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] Lock "cinder-quobyte-95fc7521-3b7f-4d6a-9978-2dff067a2824" released by "delete_volume" :: held 1.658s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:46 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] Created reservations ['2c0bd00a-0ec3-4de4-9798-d750f162b4e6', 'e0fcd844-95a1-414e-ae36-52d230166624', 'cb5125b3-f8a7-4c23-95a6-6a8afcf539d4', 'c8207408-b476-485d-94ba-b11c78addfaa'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:38:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:46 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:38:46 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:47 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf 1G" returned: 0 in 0.939s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48b7257f-63e2-483d-a684-18a7a96936bc -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:47 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48b7257f-63e2-483d-a684-18a7a96936bc -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf Jun 02 00:38:47 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:47 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.892s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:47 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:38:47 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] Deleted volume successfully. Jun 02 00:38:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3050bd00-5234-4d1a-8150-427365002757 tempest-VolumesTestJSON-1678906826 None] Lock "cinder-95fc7521-3b7f-4d6a-9978-2dff067a2824-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:38:47 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48b7257f-63e2-483d-a684-18a7a96936bc -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf" returned: 0 in 0.951s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:47 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf is being set with open permissions: ugo+rw Jun 02 00:38:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:48 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf Jun 02 00:38:48 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:48 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf" returned: 0 in 0.723s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:48 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.info Jun 02 00:38:48 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:49 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.info" returned: 0 in 0.664s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:49 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.info is being set with open permissions: ugo+rw Jun 02 00:38:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:49 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.info Jun 02 00:38:49 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:50 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.info" returned: 0 in 0.637s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.846s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:50 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-9e6c7dd7-0631-49e8-b483-cd1b49d0ac1b tempest-VolumesDeleteCascade-1875024950 None] Create snapshot completed successfully Jun 02 00:38:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-90cfd1bc-88ed-4f42-a725-7bc121a665f3 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-90cfd1bc-88ed-4f42-a725-7bc121a665f3 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-90cfd1bc-88ed-4f42-a725-7bc121a665f3 tempest-VolumesDeleteCascade-1875024950 None] Creating offline snapshot 46001945-1167-4e02-8b36-f284ba90595d of volume 48b7257f-63e2-483d-a684-18a7a96936bc {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:38:51 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc6077c-11fb-4d17-a788-8cec88b0ec7f]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-90cfd1bc-88ed-4f42-a725-7bc121a665f3 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:51 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf Jun 02 00:38:51 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:52 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-90cfd1bc-88ed-4f42-a725-7bc121a665f3 tempest-VolumesDeleteCascade-1875024950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf" returned: 0 in 1.202s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-90cfd1bc-88ed-4f42-a725-7bc121a665f3 tempest-VolumesDeleteCascade-1875024950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48b7257f-63e2-483d-a684-18a7a96936bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:38:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-90cfd1bc-88ed-4f42-a725-7bc121a665f3 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:52 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d 1G Jun 02 00:38:52 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:53 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-3cfc5119-523e-404b-b76c-854e35ccc5da tempest-GroupSnapshotsV319Test-1384321416 None] Group tempest-GroupSnapshotsV319Test-Group-482934883: creating Jun 02 00:38:53 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-3cfc5119-523e-404b-b76c-854e35ccc5da tempest-GroupSnapshotsV319Test-1384321416 None] Group tempest-GroupSnapshotsV319Test-Group-482934883: created successfully Jun 02 00:38:53 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-3cfc5119-523e-404b-b76c-854e35ccc5da tempest-GroupSnapshotsV319Test-1384321416 None] Create group completed successfully. Jun 02 00:38:53 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-90cfd1bc-88ed-4f42-a725-7bc121a665f3 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d 1G" returned: 0 in 1.484s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-90cfd1bc-88ed-4f42-a725-7bc121a665f3 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:53 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d Jun 02 00:38:53 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:54 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-90cfd1bc-88ed-4f42-a725-7bc121a665f3 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d" returned: 0 in 0.774s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:54 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-90cfd1bc-88ed-4f42-a725-7bc121a665f3 tempest-VolumesDeleteCascade-1875024950 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d is being set with open permissions: ugo+rw Jun 02 00:38:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-90cfd1bc-88ed-4f42-a725-7bc121a665f3 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:54 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d Jun 02 00:38:54 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Flow 'volume_create_manager' (f9eed1f0-2188-4398-bde9-e18aff034e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eaf1164-87c4-4532-84f9-55bab35f10ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eaf1164-87c4-4532-84f9-55bab35f10ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-168651221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47a51c15-1374-44aa-96d3-0006f3d06062,host='devstack@QuobyteHD#QuobyteHD',id=f1b3f186-d449-4648-8541-fbec33acf626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f85d5899fe40d3b6fef69b7bc030ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:55Z,use_quota=True,user_id='5c67ea800bd340e6a1a6c8343d111de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a08590fe-0587-41a8-8eed-5aba2d0c1e26),volume_type_id=a08590fe-0587-41a8-8eed-5aba2d0c1e26)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94105c2b-d789-4168-a40b-039d02d8f7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94105c2b-d789-4168-a40b-039d02d8f7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c304be-465c-4d42-b451-169896932bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c304be-465c-4d42-b451-169896932bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1b3f186-d449-4648-8541-fbec33acf626', 'volume_name': 'volume-f1b3f186-d449-4648-8541-fbec33acf626', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531a58d9-677e-43ce-95e5-c1d91e5da334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531a58d9-677e-43ce-95e5-c1d91e5da334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e169bf-f0a2-4dcb-9695-67119c0a77ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:55 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Volume f1b3f186-d449-4648-8541-fbec33acf626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1b3f186-d449-4648-8541-fbec33acf626', 'volume_size': 1} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:55 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-90cfd1bc-88ed-4f42-a725-7bc121a665f3 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d" returned: 0 in 1.099s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-90cfd1bc-88ed-4f42-a725-7bc121a665f3 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.766s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.118s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=47a51c15-1374-44aa-96d3-0006f3d06062,created_at=2026-06-01T22:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-168651221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47a51c15-1374-44aa-96d3-0006f3d06062,host='devstack@QuobyteHD#QuobyteHD',id=f1b3f186-d449-4648-8541-fbec33acf626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f85d5899fe40d3b6fef69b7bc030ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:38:55Z,use_quota=True,user_id='5c67ea800bd340e6a1a6c8343d111de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a08590fe-0587-41a8-8eed-5aba2d0c1e26),volume_type_id=a08590fe-0587-41a8-8eed-5aba2d0c1e26)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Creating volume f1b3f186-d449-4648-8541-fbec33acf626 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:38:55 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:38:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:55 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626 1073741824 Jun 02 00:38:55 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:55 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-90cfd1bc-88ed-4f42-a725-7bc121a665f3 tempest-VolumesDeleteCascade-1875024950 None] Create snapshot completed successfully Jun 02 00:38:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "cinder-48b7257f-63e2-483d-a684-18a7a96936bc-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-48b7257f-63e2-483d-a684-18a7a96936bc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Performing cascade delete. {{(pid=86910) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 02 00:38:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "cinder-46001945-1167-4e02-8b36-f284ba90595d-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-46001945-1167-4e02-8b36-f284ba90595d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "cinder-quobyte-48b7257f-63e2-483d-a684-18a7a96936bc" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-48b7257f-63e2-483d-a684-18a7a96936bc" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "cinder-quobyte-46001945-1167-4e02-8b36-f284ba90595d" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:38:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-46001945-1167-4e02-8b36-f284ba90595d" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:38:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Deleting offline snapshot 46001945-1167-4e02-8b36-f284ba90595d of volume 48b7257f-63e2-483d-a684-18a7a96936bc {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:38:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] snapshot_file for this snap is: volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:38:56 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd21f91-9d98-47b6-a1b4-40349ef5cc57]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:57 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626 1073741824" returned: 0 in 1.271s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:57 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d Jun 02 00:38:57 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:57 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626 Jun 02 00:38:57 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:57 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626" returned: 0 in 0.731s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] <== create_volume: return (2061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:38:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:38:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e169bf-f0a2-4dcb-9695-67119c0a77ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1b3f186-d449-4648-8541-fbec33acf626', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c602cf1-c9ed-4f8c-afe8-c6ecc1b505cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:38:57 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Volume volume-f1b3f186-d449-4648-8541-fbec33acf626 (f1b3f186-d449-4648-8541-fbec33acf626): created successfully Jun 02 00:38:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c602cf1-c9ed-4f8c-afe8-c6ecc1b505cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:38:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Flow 'volume_create_manager' (f9eed1f0-2188-4398-bde9-e18aff034e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:38:57 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-c0efc574-9dc5-4732-8ab8-e59c02fefe61 tempest-GroupSnapshotsV319Test-1384321416 None] Created volume successfully. Jun 02 00:38:57 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d" returned: 0 in 1.088s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48b7257f-63e2-483d-a684-18a7a96936bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:38:57 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa825ef-63ee-40db-a772-02245f222f68]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:58 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf Jun 02 00:38:58 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:58 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf" returned: 0 in 0.776s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48b7257f-63e2-483d-a684-18a7a96936bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:38:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:58 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d Jun 02 00:38:58 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:59 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] GroupSnapshot da3d0582-2c15-45a3-a134-05ac1c2cb18a: creating. Jun 02 00:38:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] Group snapshot da3d0582-2c15-45a3-a134-05ac1c2cb18a: creating. {{(pid=86910) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 02 00:38:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:38:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:38:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] Creating offline snapshot c5154114-be5b-4536-9392-2d4bde68020b of volume f1b3f186-d449-4648-8541-fbec33acf626 {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:38:59 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56ea312-ef80-4327-85f6-25e9be0cdf79]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:38:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:59 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626 Jun 02 00:38:59 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:38:59 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Jun 02 00:38:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d" returned: 0 in 0.887s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:38:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:38:59 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d Jun 02 00:38:59 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Flow 'volume_create_manager' (4cba9ece-c5dd-4941-a656-f9ce1235151b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d84a14-97f3-4ba6-96b2-496dc5cea24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d84a14-97f3-4ba6-96b2-496dc5cea24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1792687276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d53c85-419c-41b4-a771-5a2cb0a963e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb446f3c6ab4c948e314b1aaebc85e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:00Z,use_quota=True,user_id='3ee1159948d24625afa6c04f5d360b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb2be9d-d77f-445c-aa97-424f3db63f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb2be9d-d77f-445c-aa97-424f3db63f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d2504a-057c-4566-a976-2d09f8e17f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d2504a-057c-4566-a976-2d09f8e17f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78d53c85-419c-41b4-a771-5a2cb0a963e3', 'volume_name': 'volume-78d53c85-419c-41b4-a771-5a2cb0a963e3', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7049ccb6-56a7-4c70-9fa3-bc92bba478a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7049ccb6-56a7-4c70-9fa3-bc92bba478a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36d5e67-915a-4c3d-95cd-216d3122e29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:00 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Volume 78d53c85-419c-41b4-a771-5a2cb0a963e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78d53c85-419c-41b4-a771-5a2cb0a963e3', 'volume_size': 1} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:00 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.46001945-1167-4e02-8b36-f284ba90595d" returned: 0 in 0.720s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-46001945-1167-4e02-8b36-f284ba90595d" released by "_delete_snapshot" :: held 3.639s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-48b7257f-63e2-483d-a684-18a7a96936bc" released by "delete_snapshot" :: held 3.698s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:00 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626" returned: 0 in 1.034s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:00 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b 1G Jun 02 00:39:00 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Created reservations ['43c4dccf-9a8f-473b-a02c-1927a9c6b269', 'b42f0f8b-b616-44e9-b685-71cebd5cf4e1', 'ffe223a2-1a23-4a37-afff-41cf1960ffdc', '724d556a-7052-420e-a1d5-bcaa0ed76e79'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:39:00 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Delete snapshot completed successfully. Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-46001945-1167-4e02-8b36-f284ba90595d-delete_snapshot" released by "delete_snapshot" :: held 3.877s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "cinder-ea51e32f-39a7-45ee-9c73-2ccf414093cf-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-ea51e32f-39a7-45ee-9c73-2ccf414093cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "cinder-quobyte-48b7257f-63e2-483d-a684-18a7a96936bc" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-48b7257f-63e2-483d-a684-18a7a96936bc" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "cinder-quobyte-ea51e32f-39a7-45ee-9c73-2ccf414093cf" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-ea51e32f-39a7-45ee-9c73-2ccf414093cf" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Deleting offline snapshot ea51e32f-39a7-45ee-9c73-2ccf414093cf of volume 48b7257f-63e2-483d-a684-18a7a96936bc {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] snapshot_file for this snap is: volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a268178e-a31d-489e-81c8-e31a0242af83]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:00 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf Jun 02 00:39:00 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:01 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b 1G" returned: 0 in 0.830s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1b3f186-d449-4648-8541-fbec33acf626 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:01 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1b3f186-d449-4648-8541-fbec33acf626 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b Jun 02 00:39:01 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:01 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf" returned: 0 in 0.769s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48b7257f-63e2-483d-a684-18a7a96936bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:39:01 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[def7eb67-9a67-4159-ac93-447fb1a23b9a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:01 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc Jun 02 00:39:01 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:02 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1b3f186-d449-4648-8541-fbec33acf626 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b" returned: 0 in 0.752s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:02 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b is being set with open permissions: ugo+rw: NotImplementedError Jun 02 00:39:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:02 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b Jun 02 00:39:02 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:02 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc" returned: 0 in 0.847s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:02 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf Jun 02 00:39:02 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:02 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b" returned: 0 in 0.703s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:02 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.info Jun 02 00:39:02 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:03 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf" returned: 0 in 0.847s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:03 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf Jun 02 00:39:03 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:03 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.info" returned: 0 in 0.640s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:03 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 00:39:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:03 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.info Jun 02 00:39:03 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:03 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc.ea51e32f-39a7-45ee-9c73-2ccf414093cf" returned: 0 in 0.653s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-ea51e32f-39a7-45ee-9c73-2ccf414093cf" released by "_delete_snapshot" :: held 3.245s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-48b7257f-63e2-483d-a684-18a7a96936bc" released by "delete_snapshot" :: held 3.286s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Created reservations ['3d4d2449-f256-4ea2-b752-26c47bce6a91', '8721fc0b-5894-49c7-bf88-d6e16ca0449e', '3283c281-d295-49f0-90c3-3e71b2af3f58', 'c8131568-ea11-403e-a799-7605491b389e'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:39:04 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Delete snapshot completed successfully. Jun 02 00:39:04 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-ea51e32f-39a7-45ee-9c73-2ccf414093cf-delete_snapshot" released by "delete_snapshot" :: held 3.507s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Snapshots deleted, issuing volume delete {{(pid=86910) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "cinder-quobyte-48b7257f-63e2-483d-a684-18a7a96936bc" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.info" returned: 0 in 0.675s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.762s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.968s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1792687276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d53c85-419c-41b4-a771-5a2cb0a963e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb446f3c6ab4c948e314b1aaebc85e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:00Z,use_quota=True,user_id='3ee1159948d24625afa6c04f5d360b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Creating volume 78d53c85-419c-41b4-a771-5a2cb0a963e3 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:39:04 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-78d53c85-419c-41b4-a771-5a2cb0a963e3 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-48b7257f-63e2-483d-a684-18a7a96936bc" acquired by "delete_volume" :: waited 0.086s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:04 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-78d53c85-419c-41b4-a771-5a2cb0a963e3 1073741824 Jun 02 00:39:04 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[521535c1-d1e9-4c1e-9aec-a33b6358e964]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:04 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-38f99639-34a1-4ab6-9592-36c2bf01c79a tempest-GroupSnapshotsV319Test-1384321416 None] group_snapshot da3d0582-2c15-45a3-a134-05ac1c2cb18a: created successfully Jun 02 00:39:04 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc Jun 02 00:39:04 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:05 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-78d53c85-419c-41b4-a771-5a2cb0a963e3 1073741824" returned: 0 in 0.860s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-78d53c85-419c-41b4-a771-5a2cb0a963e3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:05 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc" returned: 0 in 0.814s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:05 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-78d53c85-419c-41b4-a771-5a2cb0a963e3 Jun 02 00:39:05 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:05 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc Jun 02 00:39:05 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:05 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] group_snapshot da3d0582-2c15-45a3-a134-05ac1c2cb18a: deleting Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] group_snapshot da3d0582-2c15-45a3-a134-05ac1c2cb18a: deleting {{(pid=86910) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] Acquiring lock "cinder-quobyte-f1b3f186-d449-4648-8541-fbec33acf626" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] Lock "cinder-quobyte-f1b3f186-d449-4648-8541-fbec33acf626" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] Acquiring lock "cinder-quobyte-c5154114-be5b-4536-9392-2d4bde68020b" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] Lock "cinder-quobyte-c5154114-be5b-4536-9392-2d4bde68020b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] Deleting offline snapshot c5154114-be5b-4536-9392-2d4bde68020b of volume f1b3f186-d449-4648-8541-fbec33acf626 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] snapshot_file for this snap is: volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d03695-fc23-4fdd-b126-d671258bf5aa]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:05 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b Jun 02 00:39:05 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:05 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-78d53c85-419c-41b4-a771-5a2cb0a963e3" returned: 0 in 0.633s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36d5e67-915a-4c3d-95cd-216d3122e29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78d53c85-419c-41b4-a771-5a2cb0a963e3', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97710374-3072-4881-a275-cc355a732b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:05 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48b7257f-63e2-483d-a684-18a7a96936bc" returned: 0 in 0.660s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:05 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Volume volume-78d53c85-419c-41b4-a771-5a2cb0a963e3 (78d53c85-419c-41b4-a771-5a2cb0a963e3): created successfully Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97710374-3072-4881-a275-cc355a732b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Flow 'volume_create_manager' (4cba9ece-c5dd-4941-a656-f9ce1235151b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-48b7257f-63e2-483d-a684-18a7a96936bc" released by "delete_volume" :: held 1.577s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:05 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e1a22a3f-491d-48a8-87ca-95b97a62b8e4 tempest-AbsoluteLimitsTests-1653397270 None] Created volume successfully. Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Created reservations ['efc9648a-4383-4ed1-a9ec-9233f72c6687', '2877c98e-dcfa-44cb-a657-3bcbf99d2226', '5b5b5e50-8f98-4769-8ed3-70e1768e61b5', 'ad04d3b0-a504-4ba3-83fa-9c345fefc1d0'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:05 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:39:05 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:06 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b" returned: 0 in 0.731s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1b3f186-d449-4648-8541-fbec33acf626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0aaebc-17d3-472b-8fc7-29c07ce8ce2e]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:06 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626 Jun 02 00:39:06 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:06 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.623s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:39:06 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Deleted volume successfully. Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e7464142-7097-4297-ae78-7dcb5949513a tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-48b7257f-63e2-483d-a684-18a7a96936bc-delete_volume" released by "delete_volume" :: held 10.103s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] Acquiring lock "cinder-78d53c85-419c-41b4-a771-5a2cb0a963e3-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] Lock "cinder-78d53c85-419c-41b4-a771-5a2cb0a963e3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] Acquiring lock "cinder-quobyte-78d53c85-419c-41b4-a771-5a2cb0a963e3" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] Lock "cinder-quobyte-78d53c85-419c-41b4-a771-5a2cb0a963e3" acquired by "delete_volume" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b018770-ed84-4e88-bbee-70074623abf1]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-78d53c85-419c-41b4-a771-5a2cb0a963e3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:06 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626" returned: 0 in 0.789s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:06 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b Jun 02 00:39:06 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:06 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-78d53c85-419c-41b4-a771-5a2cb0a963e3 Jun 02 00:39:06 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Flow 'volume_create_manager' (b3521aab-7578-4d79-9c8b-697320c87e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:06 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475b1e9b-b5a3-4dbf-9306-3e40536c362f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475b1e9b-b5a3-4dbf-9306-3e40536c362f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-737099480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0584f003-ad53-4d1c-ac1f-c0d7c07da9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fcea00b006247fcbd36a2c92c619787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:07Z,use_quota=True,user_id='dd1053f3fe264778a7b083a867f57ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc08a4cd-19cc-4692-b2ee-77b8074246af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc08a4cd-19cc-4692-b2ee-77b8074246af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f13b8c6-a1d2-4c23-8ca3-e67ced850258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f13b8c6-a1d2-4c23-8ca3-e67ced850258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0584f003-ad53-4d1c-ac1f-c0d7c07da9fa', 'volume_name': 'volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65feb058-395a-4542-a560-0fda2400385b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65feb058-395a-4542-a560-0fda2400385b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15834ad-28a3-4ae5-b9cb-68521a53c26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:07 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Volume 0584f003-ad53-4d1c-ac1f-c0d7c07da9fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa', 'volume_size': 1} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-737099480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0584f003-ad53-4d1c-ac1f-c0d7c07da9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fcea00b006247fcbd36a2c92c619787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:07Z,use_quota=True,user_id='dd1053f3fe264778a7b083a867f57ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Creating volume 0584f003-ad53-4d1c-ac1f-c0d7c07da9fa {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:39:07 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:07 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa 1073741824 Jun 02 00:39:07 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:07 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b" returned: 0 in 0.713s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:07 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-78d53c85-419c-41b4-a771-5a2cb0a963e3" returned: 0 in 0.765s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-78d53c85-419c-41b4-a771-5a2cb0a963e3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:07 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b Jun 02 00:39:07 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:07 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-78d53c85-419c-41b4-a771-5a2cb0a963e3 Jun 02 00:39:07 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:07 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa 1073741824" returned: 0 in 0.795s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:07 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa Jun 02 00:39:07 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:08 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626.c5154114-be5b-4536-9392-2d4bde68020b" returned: 0 in 0.601s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] Lock "cinder-quobyte-c5154114-be5b-4536-9392-2d4bde68020b" released by "_delete_snapshot" :: held 2.965s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] Lock "cinder-quobyte-f1b3f186-d449-4648-8541-fbec33acf626" released by "delete_snapshot" :: held 2.988s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:08 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-78d53c85-419c-41b4-a771-5a2cb0a963e3" returned: 0 in 0.638s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] Lock "cinder-quobyte-78d53c85-419c-41b4-a771-5a2cb0a963e3" released by "delete_volume" :: held 1.452s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:08 devstack cinder-volume[86910]: WARNING cinder.quota [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-942875804 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-942875804, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:39:08 devstack cinder-volume[86910]: WARNING cinder.quota [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-942875804 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-942875804, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] Created reservations ['52bc4354-a313-44b2-9b9c-d549b1e2e957', 'f95b6f62-a8d0-4e98-ba2c-04aae3d9f8eb', '83b0a2e5-5a4d-4058-b0c4-05653fe6aa5c', 'd6a4c393-9adf-4921-b1c3-9dcdedd7bff0'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] Created reservations ['d6b922e2-a4e1-46be-b954-0122946ffaec', '7d57b095-63c8-4d5e-a001-dee6d0a526e8', '0d598577-26bd-4734-ae9a-1a2a6ac28253', '45991e17-7d97-4def-a2cb-43bf20fc4c86'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:08 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:39:08 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:08 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-74fd0807-ce4c-4b19-83ca-7af526ab1737 tempest-GroupSnapshotsV319Test-1384321416 None] group_snapshot da3d0582-2c15-45a3-a134-05ac1c2cb18a: deleted successfully Jun 02 00:39:08 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa" returned: 0 in 0.656s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15834ad-28a3-4ae5-b9cb-68521a53c26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779ab5bb-2ff6-4e5c-8fc7-5c8a80d6e109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:08 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Volume volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa (0584f003-ad53-4d1c-ac1f-c0d7c07da9fa): created successfully Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779ab5bb-2ff6-4e5c-8fc7-5c8a80d6e109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Flow 'volume_create_manager' (b3521aab-7578-4d79-9c8b-697320c87e69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:08 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a163da19-ce46-45e4-8416-ed79466f87b0 tempest-VolumesDeleteCascade-1875024950 None] Created volume successfully. Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] Acquiring lock "cinder-quobyte-f1b3f186-d449-4648-8541-fbec33acf626" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] Lock "cinder-quobyte-f1b3f186-d449-4648-8541-fbec33acf626" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[374689d1-0ba2-4c0a-bbfb-306f68d8b743]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:08 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626 Jun 02 00:39:08 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:08 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.622s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:08 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:39:08 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] Deleted volume successfully. Jun 02 00:39:09 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6df4ee15-c513-4846-8ee6-80aec8fc7fde tempest-AbsoluteLimitsTests-1653397270 None] Lock "cinder-78d53c85-419c-41b4-a771-5a2cb0a963e3-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:09 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] Creating offline snapshot e84382a9-4218-44ae-b124-6b0e31ac9782 of volume 0584f003-ad53-4d1c-ac1f-c0d7c07da9fa {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:39:09 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[239074a1-8509-4a69-b866-5074d2c4e34e]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:09 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa Jun 02 00:39:09 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:09 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626" returned: 0 in 0.786s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:09 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626 Jun 02 00:39:09 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:10 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa" returned: 0 in 0.757s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:10 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f1b3f186-d449-4648-8541-fbec33acf626" returned: 0 in 0.608s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:10 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782 1G Jun 02 00:39:10 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] Lock "cinder-quobyte-f1b3f186-d449-4648-8541-fbec33acf626" released by "delete_volume" :: held 1.466s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:10 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] Created reservations ['99955d8c-1f9f-4080-8edb-a0f6e50812d9'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:39:10 devstack cinder-volume[86910]: WARNING cinder.quota [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-942875804 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-942875804, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:39:10 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] Created reservations ['c2ef1d9b-31ba-429d-806b-a89c9d571731', '9c2b7a88-0b2b-4d30-aca2-179afe2b0303', '477db11d-276c-42a8-a60b-fc23483a12d8', 'd6de5e3c-59b6-4e8a-9197-59ead0b040fe'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:39:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:10 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:39:10 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:11 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782 1G" returned: 0 in 1.028s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:11 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782 Jun 02 00:39:11 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:11 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.945s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:11 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:39:11 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-dd19545b-bb4a-44de-8646-4cb46eb88838 tempest-GroupSnapshotsV319Test-1384321416 None] Delete group completed successfully. Jun 02 00:39:12 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782" returned: 0 in 0.916s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:12 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782 is being set with open permissions: ugo+rw Jun 02 00:39:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:12 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782 Jun 02 00:39:12 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:12 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782" returned: 0 in 0.712s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:12 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.info Jun 02 00:39:12 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:13 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.info" returned: 0 in 0.734s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:13 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.info is being set with open permissions: ugo+rw Jun 02 00:39:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:13 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.info Jun 02 00:39:13 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:14 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.info" returned: 0 in 0.640s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.900s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:14 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-fd5ac278-0a28-4da9-aa8f-8870f261e667 tempest-VolumesDeleteCascade-1875024950 None] Create snapshot completed successfully Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Flow 'volume_create_manager' (9575d59a-e7d9-4f62-9ac2-eaa282ff0a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d464e4e-7789-4a79-94ea-37c8027d3044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d464e4e-7789-4a79-94ea-37c8027d3044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1608583690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca51e4a-b71c-4afd-991f-4a6a486cee22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fcea00b006247fcbd36a2c92c619787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e84382a9-4218-44ae-b124-6b0e31ac9782,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:15Z,use_quota=True,user_id='dd1053f3fe264778a7b083a867f57ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e778377-b116-45cc-9e25-bff4aa0675e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e778377-b116-45cc-9e25-bff4aa0675e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba3f00e-ff62-4185-bdf2-69aa6b970a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba3f00e-ff62-4185-bdf2-69aa6b970a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ca51e4a-b71c-4afd-991f-4a6a486cee22', 'volume_name': 'volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22', 'volume_size': 1, 'snapshot_id': 'e84382a9-4218-44ae-b124-6b0e31ac9782'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8154827-1b80-4115-88bc-08b1e042178e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8154827-1b80-4115-88bc-08b1e042178e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bab94a-3774-43b0-bd7b-d103bc341d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:15 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Volume 9ca51e4a-b71c-4afd-991f-4a6a486cee22: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22', 'volume_size': 1, 'snapshot_id': 'e84382a9-4218-44ae-b124-6b0e31ac9782'} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "cinder-quobyte-e84382a9-4218-44ae-b124-6b0e31ac9782-9ca51e4a-b71c-4afd-991f-4a6a486cee22" by "_create_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:15 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:39:15 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-e84382a9-4218-44ae-b124-6b0e31ac9782-9ca51e4a-b71c-4afd-991f-4a6a486cee22" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Creating volume 9ca51e4a-b71c-4afd-991f-4a6a486cee22 from snapshot e84382a9-4218-44ae-b124-6b0e31ac9782 {{(pid=86910) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "cinder-quobyte-9ca51e4a-b71c-4afd-991f-4a6a486cee22" by "_copy_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-9ca51e4a-b71c-4afd-991f-4a6a486cee22" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] snapshot: e84382a9-4218-44ae-b124-6b0e31ac9782, volume: 9ca51e4a-b71c-4afd-991f-4a6a486cee22, {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[79222d15-b6bb-4d0b-9b31-f547e1c981a8]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:15 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782 Jun 02 00:39:15 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Flow 'volume_create_manager' (e10b0904-f544-4816-b727-d7a460aac028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d0f861-4a48-4f78-a6ef-56bfc3626020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d0f861-4a48-4f78-a6ef-56bfc3626020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-734273059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33e6cb1f393a4439a2c1ea8a9a725b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:16Z,use_quota=True,user_id='934478926745448aa285accce20a801b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8507a088-c40d-46af-b37f-985e12793d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8507a088-c40d-46af-b37f-985e12793d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6c8346-f039-46b7-a204-eaf5798168b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6c8346-f039-46b7-a204-eaf5798168b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6', 'volume_name': 'volume-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d9b2fe-8ee4-49a0-9275-1a02116a557b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d9b2fe-8ee4-49a0-9275-1a02116a557b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692e1852-6577-4edd-a0ae-bee0d3bb2e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:15 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Volume 46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6', 'volume_size': 1} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Flow 'volume_create_manager' (f8cd8350-a020-4337-b477-2a2a43d64068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7371d711-7c3b-41d8-8fd0-650324b7dfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7371d711-7c3b-41d8-8fd0-650324b7dfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-821293961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3180e254-fa35-4c09-a26f-d2763aba866a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a3586c6f00c4268ae83b0472363ce70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:16Z,use_quota=True,user_id='b83f53be71d74fc79c4f967bd4ec6e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909d95fd-d3df-4016-afeb-a8879fc58eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909d95fd-d3df-4016-afeb-a8879fc58eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c826c236-3279-4b73-92b4-06b575f743f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c826c236-3279-4b73-92b4-06b575f743f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3180e254-fa35-4c09-a26f-d2763aba866a', 'volume_name': 'volume-3180e254-fa35-4c09-a26f-d2763aba866a', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f863d63b-6056-4442-baef-9671f25ee5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f863d63b-6056-4442-baef-9671f25ee5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08183fd7-26c9-4892-97f0-e818131a7cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:15 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Volume 3180e254-fa35-4c09-a26f-d2763aba866a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3180e254-fa35-4c09-a26f-d2763aba866a', 'volume_size': 1} Jun 02 00:39:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:16 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.927s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:16 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:39:16 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782" returned: 0 in 0.892s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:39:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 00:39:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Creating direct copy from snapshot {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 00:39:16 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8645517-ddb2-4be5-b970-8c5f660b3e82]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:16 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa Jun 02 00:39:16 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:17 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa" returned: 0 in 0.703s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:17 devstack cinder-volume[86910]: DEBUG cinder.utils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Path /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22 not found in is_blk_device check {{(pid=86910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 00:39:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:17 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22 Jun 02 00:39:17 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:17 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ca22cf6d-9799-4776-a545-8202985d2205 tempest-GroupsV314Test-1595069850 None] Group tempest-GroupsV314Test-Group-159398446: creating Jun 02 00:39:17 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ca22cf6d-9799-4776-a545-8202985d2205 tempest-GroupsV314Test-1595069850 None] Group tempest-GroupsV314Test-Group-159398446: created successfully Jun 02 00:39:17 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ca22cf6d-9799-4776-a545-8202985d2205 tempest-GroupsV314Test-1595069850 None] Create group completed successfully. Jun 02 00:39:19 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:39:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Flow 'volume_create_manager' (70eafa93-ea70-448d-8984-5bbe8616f0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d17223f-9341-43af-88de-31cea244dc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d17223f-9341-43af-88de-31cea244dc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1298784427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51a09087-c84b-43a7-8f72-bc29886a6cdb,host='devstack@QuobyteHD#QuobyteHD',id=ae0fe9ae-487c-4532-a834-7160041592c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653c3ecfd3ca4a97a76666b983ee8890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:19Z,use_quota=True,user_id='dca5e44f43654a3dbd9ee83ecd6f9da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52e4c2c3-2e4d-4b0c-bb0f-d377380703ec),volume_type_id=52e4c2c3-2e4d-4b0c-bb0f-d377380703ec)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5f725c-02fd-479b-bbf9-7877dc5f6fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5f725c-02fd-479b-bbf9-7877dc5f6fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1b600e-ffd9-41b3-9fe9-908fe395e433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1b600e-ffd9-41b3-9fe9-908fe395e433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae0fe9ae-487c-4532-a834-7160041592c9', 'volume_name': 'volume-ae0fe9ae-487c-4532-a834-7160041592c9', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ee3cd6-3ec7-4951-8052-0d2a8087c1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ee3cd6-3ec7-4951-8052-0d2a8087c1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf061f28-8019-49a6-b141-d8a2cb40d577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:19 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Volume ae0fe9ae-487c-4532-a834-7160041592c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae0fe9ae-487c-4532-a834-7160041592c9', 'volume_size': 1} Jun 02 00:39:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:22 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22" returned: 0 in 5.002s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:22 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[13322498-ca84-490e-8c30-677925879af2]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:22 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa Jun 02 00:39:22 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:22 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa" returned: 0 in 0.829s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:22 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Image conversion details: src /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa, size 1024.00 MB, duration 5.00 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22 {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:39:22 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Converted 1024.00 MB image at 204.67 MB/s Jun 02 00:39:22 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22 is being set with open permissions: ugo+rw Jun 02 00:39:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:22 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22 Jun 02 00:39:22 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:23 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22" returned: 0 in 0.575s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-9ca51e4a-b71c-4afd-991f-4a6a486cee22" released by "_copy_volume_from_snapshot" :: held 8.135s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-e84382a9-4218-44ae-b124-6b0e31ac9782-9ca51e4a-b71c-4afd-991f-4a6a486cee22" released by "_create_volume_from_snapshot" :: held 8.179s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.203s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.575s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-734273059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33e6cb1f393a4439a2c1ea8a9a725b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:16Z,use_quota=True,user_id='934478926745448aa285accce20a801b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Creating volume 46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:39:23 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:23 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6 1073741824 Jun 02 00:39:23 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bab94a-3774-43b0-bd7b-d103bc341d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22', 'volume_size': 1, 'snapshot_id': 'e84382a9-4218-44ae-b124-6b0e31ac9782'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9e098f-a20c-4cea-9ffc-cbd77d43ca84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:23 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Volume volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22 (9ca51e4a-b71c-4afd-991f-4a6a486cee22): created successfully Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9e098f-a20c-4cea-9ffc-cbd77d43ca84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Flow 'volume_create_manager' (9575d59a-e7d9-4f62-9ac2-eaa282ff0a80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:23 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-437866d9-92ab-4b50-8fe0-0a9bd33ebd55 tempest-VolumesDeleteCascade-1875024950 None] Created volume successfully. Jun 02 00:39:24 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6 1073741824" returned: 0 in 0.736s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:24 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6 Jun 02 00:39:24 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "cinder-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Performing cascade delete. {{(pid=86910) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "cinder-e84382a9-4218-44ae-b124-6b0e31ac9782-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-e84382a9-4218-44ae-b124-6b0e31ac9782-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "cinder-quobyte-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "cinder-quobyte-e84382a9-4218-44ae-b124-6b0e31ac9782" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-e84382a9-4218-44ae-b124-6b0e31ac9782" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Deleting offline snapshot e84382a9-4218-44ae-b124-6b0e31ac9782 of volume 0584f003-ad53-4d1c-ac1f-c0d7c07da9fa {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] snapshot_file for this snap is: volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b801d6d8-e99b-4c00-9568-4a4bef779f0b]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:24 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782 Jun 02 00:39:24 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:24 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6" returned: 0 in 0.627s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.891s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-821293961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3180e254-fa35-4c09-a26f-d2763aba866a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a3586c6f00c4268ae83b0472363ce70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:16Z,use_quota=True,user_id='b83f53be71d74fc79c4f967bd4ec6e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Creating volume 3180e254-fa35-4c09-a26f-d2763aba866a {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:39:24 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3180e254-fa35-4c09-a26f-d2763aba866a 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:24 devstack sudo[96095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3180e254-fa35-4c09-a26f-d2763aba866a 1073741824 Jun 02 00:39:24 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692e1852-6577-4edd-a0ae-bee0d3bb2e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b91c8d0f-0434-4db0-97ee-e9a7ad66738a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:24 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Volume volume-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6 (46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6): created successfully Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b91c8d0f-0434-4db0-97ee-e9a7ad66738a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Flow 'volume_create_manager' (e10b0904-f544-4816-b727-d7a460aac028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:24 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-9cb6bda3-474d-41a9-a32f-86675b9b4927 tempest-VolumesTransfersV357Test-913192168 None] Created volume successfully. Jun 02 00:39:25 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782" returned: 0 in 0.714s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:39:25 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d478ff52-4ceb-4776-8375-df5229e352a2]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:25 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa Jun 02 00:39:25 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:25 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3180e254-fa35-4c09-a26f-d2763aba866a 1073741824" returned: 0 in 0.889s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3180e254-fa35-4c09-a26f-d2763aba866a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:25 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3180e254-fa35-4c09-a26f-d2763aba866a Jun 02 00:39:25 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:25 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa" returned: 0 in 0.751s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:26 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782 Jun 02 00:39:26 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:26 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-287fc2bc-ea5d-4e78-ada1-e1594ff04320 tempest-VolumesTransfersV357Test-1543739311 None] Transfer volume completed successfully. Jun 02 00:39:26 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3180e254-fa35-4c09-a26f-d2763aba866a" returned: 0 in 0.635s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.896s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=51a09087-c84b-43a7-8f72-bc29886a6cdb,created_at=2026-06-01T22:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1298784427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51a09087-c84b-43a7-8f72-bc29886a6cdb,host='devstack@QuobyteHD#QuobyteHD',id=ae0fe9ae-487c-4532-a834-7160041592c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653c3ecfd3ca4a97a76666b983ee8890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:19Z,use_quota=True,user_id='dca5e44f43654a3dbd9ee83ecd6f9da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52e4c2c3-2e4d-4b0c-bb0f-d377380703ec),volume_type_id=52e4c2c3-2e4d-4b0c-bb0f-d377380703ec)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Creating volume ae0fe9ae-487c-4532-a834-7160041592c9 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:39:26 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08183fd7-26c9-4892-97f0-e818131a7cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3180e254-fa35-4c09-a26f-d2763aba866a', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:26 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 1073741824 Jun 02 00:39:26 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9c6ad0-2dff-43b9-b1ef-36c05c6b38d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:26 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Volume volume-3180e254-fa35-4c09-a26f-d2763aba866a (3180e254-fa35-4c09-a26f-d2763aba866a): created successfully Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9c6ad0-2dff-43b9-b1ef-36c05c6b38d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Flow 'volume_create_manager' (f8cd8350-a020-4337-b477-2a2a43d64068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:26 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-0d49e60d-7525-4f68-90cf-eac8405511b9 tempest-AttachVolumeShelveTestJSON-425694257 None] Created volume successfully. Jun 02 00:39:26 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782" returned: 0 in 0.746s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:26 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782 Jun 02 00:39:26 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] Acquiring lock "cinder-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] Lock "cinder-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] Acquiring lock "cinder-quobyte-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] Lock "cinder-quobyte-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6" acquired by "delete_volume" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bff322-d976-4a3a-8e13-076925123846]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:27 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 1073741824" returned: 0 in 0.890s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:27 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa.e84382a9-4218-44ae-b124-6b0e31ac9782" returned: 0 in 0.659s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:27 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 Jun 02 00:39:27 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-e84382a9-4218-44ae-b124-6b0e31ac9782" released by "_delete_snapshot" :: held 2.966s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa" released by "delete_snapshot" :: held 2.985s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:27 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6 Jun 02 00:39:27 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Created reservations ['76110462-cf48-4340-b322-36b93bb4d6ba', '8dfa2f10-5c39-48dd-a288-70a3e7ead161', 'f0cd7536-b270-4661-9183-bdf8b0abd710', '908a2d19-ec96-4dd3-83fb-1baf8f50384f'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:39:27 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Delete snapshot completed successfully. Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-e84382a9-4218-44ae-b124-6b0e31ac9782-delete_snapshot" released by "delete_snapshot" :: held 3.151s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Snapshots deleted, issuing volume delete {{(pid=86910) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "cinder-quobyte-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa" acquired by "delete_volume" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7080fa22-85fb-44ee-a40f-de3c1cf1aae3]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:27 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa Jun 02 00:39:27 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:28 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9" returned: 0 in 0.650s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:39:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf061f28-8019-49a6-b141-d8a2cb40d577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae0fe9ae-487c-4532-a834-7160041592c9', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b103b36c-67ab-4f16-a9f5-55fcbde293c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:28 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Volume volume-ae0fe9ae-487c-4532-a834-7160041592c9 (ae0fe9ae-487c-4532-a834-7160041592c9): created successfully Jun 02 00:39:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b103b36c-67ab-4f16-a9f5-55fcbde293c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Flow 'volume_create_manager' (70eafa93-ea70-448d-8984-5bbe8616f0fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:28 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f2f6c2d9-07cb-4648-8a7c-503908a5cd92 tempest-GroupsV314Test-1595069850 None] Created volume successfully. Jun 02 00:39:28 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6" returned: 0 in 0.897s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:28 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6 Jun 02 00:39:28 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:28 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa" returned: 0 in 0.831s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:28 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa Jun 02 00:39:28 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:28 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6" returned: 0 in 0.692s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] Lock "cinder-quobyte-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6" released by "delete_volume" :: held 1.632s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:28 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] Created reservations ['a15b8ae8-b376-4c31-85d7-f9ec17bc533c', 'c9734bb7-d78b-4041-8ed1-7bdac1216623', '8f37f369-509a-41bc-885d-f6e566ecb274', '0f42cf05-c5ff-4aa3-b86a-aaf16d30a235'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:29 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:39:29 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:29 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa" returned: 0 in 0.655s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa" released by "delete_volume" :: held 1.586s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Created reservations ['9fa43601-2431-4cb3-9082-8b0e06ec7d17', 'cc478a4f-ddb7-4077-baca-698d97039df2', 'a0bbaa0c-8774-4e4f-9c5d-036092c39443', '92d48994-d45e-45e9-8710-7c076b159d69'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:29 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:39:29 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:29 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Cloning volume ae0fe9ae-487c-4532-a834-7160041592c9 to volume 4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Creating offline snapshot 3e644a0c-bcc9-4795-aa3a-ff032e0b5015 of volume ae0fe9ae-487c-4532-a834-7160041592c9 {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89adbf7-3a1a-46bc-81be-e8c25ccb39b5]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:29 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 Jun 02 00:39:29 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:29 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.871s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:39:29 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] Deleted volume successfully. Jun 02 00:39:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4185c073-3546-4720-ab94-6ed57f8818ef tempest-VolumesTransfersV357Test-265540034 None] Lock "cinder-46e5fd9e-34ba-45fe-852a-7ce6f07c7ab6-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "cinder-9ca51e4a-b71c-4afd-991f-4a6a486cee22-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-9ca51e4a-b71c-4afd-991f-4a6a486cee22-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Flow 'volume_create_manager' (8c183887-ed27-4344-b69b-c37a0ec90490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e52d0d1-305b-44d1-990b-aab74c35aa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e52d0d1-305b-44d1-990b-aab74c35aa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1500762286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2862ee44-7971-4308-867f-0deed4c11084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33e6cb1f393a4439a2c1ea8a9a725b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:30Z,use_quota=True,user_id='934478926745448aa285accce20a801b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36344f5e-dcab-4aa7-b8b4-a84b602205c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36344f5e-dcab-4aa7-b8b4-a84b602205c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b327106-bc2e-48e8-9800-bff5089ad217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b327106-bc2e-48e8-9800-bff5089ad217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2862ee44-7971-4308-867f-0deed4c11084', 'volume_name': 'volume-2862ee44-7971-4308-867f-0deed4c11084', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9dd7a5-32fc-4dfb-a333-499818eb7e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9dd7a5-32fc-4dfb-a333-499818eb7e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94515e31-50af-45b5-aadf-d98e942fc700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:30 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Volume 2862ee44-7971-4308-867f-0deed4c11084: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2862ee44-7971-4308-867f-0deed4c11084', 'volume_size': 1} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "cinder-quobyte-9ca51e4a-b71c-4afd-991f-4a6a486cee22" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-9ca51e4a-b71c-4afd-991f-4a6a486cee22" acquired by "delete_volume" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[202cbc10-ffd1-4b64-8427-d7b59e2a027a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:30 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22 Jun 02 00:39:30 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:30 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.238s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:39:30 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Deleted volume successfully. Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6121e3b0-0e72-4383-9cd3-c559b0cdcaa9 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-0584f003-ad53-4d1c-ac1f-c0d7c07da9fa-delete_volume" released by "delete_volume" :: held 6.270s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:30 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9" returned: 0 in 1.155s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:30 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015 1G Jun 02 00:39:30 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:31 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22" returned: 0 in 1.022s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:31 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22 Jun 02 00:39:31 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:31 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015 1G" returned: 0 in 0.794s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae0fe9ae-487c-4532-a834-7160041592c9 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:31 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae0fe9ae-487c-4532-a834-7160041592c9 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015 Jun 02 00:39:31 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:31 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9ca51e4a-b71c-4afd-991f-4a6a486cee22" returned: 0 in 0.630s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-quobyte-9ca51e4a-b71c-4afd-991f-4a6a486cee22" released by "delete_volume" :: held 1.705s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:31 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] Created reservations ['cd949030-e77c-46f4-a5be-02ee3daf2244', '3a93463d-e97e-427c-87e6-704e493f296f', '8b8d0929-316d-417c-bf81-f3517ec4f7ee', '81d4844c-50c7-4b08-bbcb-ac6799117ad2'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:39:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:32 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:32 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:32 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:39:32 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:32 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae0fe9ae-487c-4532-a834-7160041592c9 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015" returned: 0 in 0.684s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:32 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015 is being set with open permissions: ugo+rw: NotImplementedError Jun 02 00:39:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:32 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015 Jun 02 00:39:32 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:32 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.654s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:32 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:39:32 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] Deleted volume successfully. Jun 02 00:39:32 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5c11b31d-a1e8-4057-a857-96278da4d9f6 tempest-VolumesDeleteCascade-1875024950 None] Lock "cinder-9ca51e4a-b71c-4afd-991f-4a6a486cee22-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:32 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015" returned: 0 in 0.652s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:32 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.info Jun 02 00:39:32 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:33 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.info" returned: 0 in 0.748s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:33 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 00:39:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:33 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.info Jun 02 00:39:33 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:34 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.info" returned: 0 in 0.674s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Acquiring lock "cinder-quobyte-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c" by "_copy_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Lock "cinder-quobyte-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:34 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] snapshot: 3e644a0c-bcc9-4795-aa3a-ff032e0b5015, volume: 4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c, {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 00:39:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:34 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:34 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:34 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f63261-b3e6-4cb4-a446-a96d2157192c]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:34 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015 Jun 02 00:39:34 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:35 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015" returned: 0 in 0.784s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae0fe9ae-487c-4532-a834-7160041592c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:39:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 00:39:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Creating direct copy from snapshot {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 00:39:35 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eedbed4-ee73-48ae-aca5-fc2b349d282b]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:35 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 Jun 02 00:39:35 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:36 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9" returned: 0 in 0.869s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:36 devstack cinder-volume[86910]: DEBUG cinder.utils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Path /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c not found in is_blk_device check {{(pid=86910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 00:39:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:36 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c Jun 02 00:39:36 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:37 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=151,cinder:INSERT=36,cinder:UPDATE=154,cinder:DELETE=11 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:39:37 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=114,cinder:INSERT=43,cinder:UPDATE=159,cinder:DELETE=12 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:39:37 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:39:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Flow 'volume_create_manager' (a860b88a-978a-4f09-af83-fa624f4b4e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (447613db-db01-4f1d-a956-b01a521c40f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (447613db-db01-4f1d-a956-b01a521c40f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-989578989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c69b9ee-2c6a-4384-90e9-ca23d17324f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547e4711caa343eead404a113792d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:37Z,use_quota=True,user_id='4e0662c80d104e88893f1520ede8447a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b29a7c1-3c30-4085-9c27-c18b17e2f341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b29a7c1-3c30-4085-9c27-c18b17e2f341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477fb201-864c-4d00-9025-542dfa78c9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477fb201-864c-4d00-9025-542dfa78c9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c69b9ee-2c6a-4384-90e9-ca23d17324f1', 'volume_name': 'volume-3c69b9ee-2c6a-4384-90e9-ca23d17324f1', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9803ff44-494c-4382-a7bd-b259a5756e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9803ff44-494c-4382-a7bd-b259a5756e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b8b222-6639-42ad-accc-e6d8d06446a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:37 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Volume 3c69b9ee-2c6a-4384-90e9-ca23d17324f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c69b9ee-2c6a-4384-90e9-ca23d17324f1', 'volume_size': 1} Jun 02 00:39:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:41 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c" returned: 0 in 5.418s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:41 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ce09e6-9dc6-43b6-aa34-4931108f8530]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:41 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 Jun 02 00:39:41 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:42 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9" returned: 0 in 0.873s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:42 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Image conversion details: src /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:39:42 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Converted 1024.00 MB image at 188.96 MB/s Jun 02 00:39:42 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c is being set with open permissions: ugo+rw: NotImplementedError Jun 02 00:39:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:42 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c Jun 02 00:39:42 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:43 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c" returned: 0 in 0.604s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Lock "cinder-quobyte-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c" released by "_copy_volume_from_snapshot" :: held 8.650s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Acquiring lock "cinder-quobyte-3e644a0c-bcc9-4795-aa3a-ff032e0b5015" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Lock "cinder-quobyte-3e644a0c-bcc9-4795-aa3a-ff032e0b5015" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Deleting offline snapshot 3e644a0c-bcc9-4795-aa3a-ff032e0b5015 of volume ae0fe9ae-487c-4532-a834-7160041592c9 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:39:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] snapshot_file for this snap is: volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:39:43 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2297d41b-fe6f-4832-a66a-b46952c7cf7a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:43 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015 Jun 02 00:39:43 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:43 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015" returned: 0 in 0.735s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae0fe9ae-487c-4532-a834-7160041592c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:39:43 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ef1513-117c-4907-873b-30493cbd0f13]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-1c66a1bf-f620-454e-8e1c-1db2c474a70f req-ab392290-6e30-4204-a9f0-334009b6359c tempest-AttachVolumeShelveTestJSON-425694257 None] No connector for attachment 2fa6a40e-d64d-44ff-ad85-701cd23e847f; skipping storage backend terminate_connection call. {{(pid=86910) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 02 00:39:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-1c66a1bf-f620-454e-8e1c-1db2c474a70f req-ab392290-6e30-4204-a9f0-334009b6359c tempest-AttachVolumeShelveTestJSON-425694257 None] Deleting attachment 2fa6a40e-d64d-44ff-ad85-701cd23e847f. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:39:43 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 Jun 02 00:39:43 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:44 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9" returned: 0 in 0.706s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:44 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015 Jun 02 00:39:44 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:45 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015" returned: 0 in 0.727s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:45 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015 Jun 02 00:39:45 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:45 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9.3e644a0c-bcc9-4795-aa3a-ff032e0b5015" returned: 0 in 0.593s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Lock "cinder-quobyte-3e644a0c-bcc9-4795-aa3a-ff032e0b5015" released by "_delete_snapshot" :: held 2.879s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.482s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.821s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1500762286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2862ee44-7971-4308-867f-0deed4c11084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33e6cb1f393a4439a2c1ea8a9a725b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:30Z,use_quota=True,user_id='934478926745448aa285accce20a801b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:39:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Creating volume 2862ee44-7971-4308-867f-0deed4c11084 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:39:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:39:45 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:39:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2862ee44-7971-4308-867f-0deed4c11084 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:46 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2862ee44-7971-4308-867f-0deed4c11084 1073741824 Jun 02 00:39:46 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:46 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-dcd84d6a-235f-48eb-b4f9-6c82c9b2359c tempest-GroupsV314Test-1595069850 None] Create group from source-group-51a09087-c84b-43a7-8f72-bc29886a6cdb completed successfully. Jun 02 00:39:46 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2862ee44-7971-4308-867f-0deed4c11084 1073741824" returned: 0 in 0.789s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2862ee44-7971-4308-867f-0deed4c11084 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:46 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2862ee44-7971-4308-867f-0deed4c11084 Jun 02 00:39:46 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] Acquiring lock "cinder-quobyte-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] Lock "cinder-quobyte-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c" acquired by "delete_volume" :: waited 0.030s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d26b7a-bf59-47c5-aa33-8d590da74d3e]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:47 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c Jun 02 00:39:47 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:47 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2862ee44-7971-4308-867f-0deed4c11084" returned: 0 in 0.612s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.718s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-989578989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c69b9ee-2c6a-4384-90e9-ca23d17324f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547e4711caa343eead404a113792d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:37Z,use_quota=True,user_id='4e0662c80d104e88893f1520ede8447a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Creating volume 3c69b9ee-2c6a-4384-90e9-ca23d17324f1 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:39:47 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3c69b9ee-2c6a-4384-90e9-ca23d17324f1 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:47 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3c69b9ee-2c6a-4384-90e9-ca23d17324f1 1073741824 Jun 02 00:39:47 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94515e31-50af-45b5-aadf-d98e942fc700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2862ee44-7971-4308-867f-0deed4c11084', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfccfc59-4dc5-4036-a013-abe0692ae2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:47 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Volume volume-2862ee44-7971-4308-867f-0deed4c11084 (2862ee44-7971-4308-867f-0deed4c11084): created successfully Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfccfc59-4dc5-4036-a013-abe0692ae2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Flow 'volume_create_manager' (8c183887-ed27-4344-b69b-c37a0ec90490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:47 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-5d4b8a0a-7ac0-4f8c-b5d6-efe6f971fe5e tempest-VolumesTransfersV357Test-913192168 None] Created volume successfully. Jun 02 00:39:47 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c" returned: 0 in 0.715s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:47 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c Jun 02 00:39:47 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:48 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3c69b9ee-2c6a-4384-90e9-ca23d17324f1 1073741824" returned: 0 in 0.834s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3c69b9ee-2c6a-4384-90e9-ca23d17324f1 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:48 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3c69b9ee-2c6a-4384-90e9-ca23d17324f1 Jun 02 00:39:48 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:48 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c" returned: 0 in 0.608s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:48 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] Lock "cinder-quobyte-4f66a2e2-f054-42d6-bc4a-8fee8ad1b10c" released by "delete_volume" :: held 1.394s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:48 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] Created reservations ['55ef483c-743f-44a5-927d-d446ab397f3c'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:39:48 devstack cinder-volume[86910]: WARNING cinder.quota [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-898893243 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-898893243, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:39:48 devstack cinder-volume[86910]: WARNING cinder.quota [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-898893243 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-898893243, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:39:48 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] Created reservations ['472fca59-6ed6-4d71-a17d-851c0ef174ef', '9a2b8edf-c57e-4a0d-8b50-372b713cbb1c', '98c790d2-ec2c-4542-b920-4ec0ed68fe76', '8ffbbb96-4d98-4f30-bddb-2e2e701566c1'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:39:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:48 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:48 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:48 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:39:48 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:48 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] Acquiring lock "cinder-2862ee44-7971-4308-867f-0deed4c11084-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] Lock "cinder-2862ee44-7971-4308-867f-0deed4c11084-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:49 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3c69b9ee-2c6a-4384-90e9-ca23d17324f1" returned: 0 in 0.727s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] Acquiring lock "cinder-quobyte-2862ee44-7971-4308-867f-0deed4c11084" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b8b222-6639-42ad-accc-e6d8d06446a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c69b9ee-2c6a-4384-90e9-ca23d17324f1', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5533562d-5c93-4551-93d2-57e9ed810fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] Lock "cinder-quobyte-2862ee44-7971-4308-867f-0deed4c11084" acquired by "delete_volume" :: waited 0.033s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:49 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Volume volume-3c69b9ee-2c6a-4384-90e9-ca23d17324f1 (3c69b9ee-2c6a-4384-90e9-ca23d17324f1): created successfully Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5533562d-5c93-4551-93d2-57e9ed810fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Flow 'volume_create_manager' (a860b88a-978a-4f09-af83-fa624f4b4e58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[43826320-9481-46e1-879b-d1463163cd72]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2862ee44-7971-4308-867f-0deed4c11084 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:49 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-20a3fb1a-2190-4e93-9c95-79ce79df1fe6 tempest-VolumesTransfersTest-273007540 None] Created volume successfully. Jun 02 00:39:49 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2862ee44-7971-4308-867f-0deed4c11084 Jun 02 00:39:49 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:49 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.626s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:39:49 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-1ae09446-9492-4c0b-95ea-ed86610c9542 tempest-GroupsV314Test-1595069850 None] Delete group completed successfully. Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] Acquiring lock "cinder-quobyte-ae0fe9ae-487c-4532-a834-7160041592c9" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] Lock "cinder-quobyte-ae0fe9ae-487c-4532-a834-7160041592c9" acquired by "delete_volume" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6854a5fd-f69b-4087-9b96-1d6db21075d8]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:49 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 Jun 02 00:39:49 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:49 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2862ee44-7971-4308-867f-0deed4c11084" returned: 0 in 0.764s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2862ee44-7971-4308-867f-0deed4c11084 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:49 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2862ee44-7971-4308-867f-0deed4c11084 Jun 02 00:39:49 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:50 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9" returned: 0 in 0.789s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:50 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9 Jun 02 00:39:50 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:50 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2862ee44-7971-4308-867f-0deed4c11084" returned: 0 in 0.660s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] Lock "cinder-quobyte-2862ee44-7971-4308-867f-0deed4c11084" released by "delete_volume" :: held 1.473s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:50 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] Created reservations ['9c486087-a519-4121-a0b8-36900ab9644e', 'fb8da24a-dbdd-4e23-9a27-232ac9eb26f4', '98b644d3-85fd-40a6-ba4c-cd16e92d1987', 'ec9196f4-70ac-40b2-8187-1fec8501388d'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:39:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:50 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:39:50 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:50 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e74c427d-8155-4c49-be89-5aa7ad8cf07f tempest-VolumesTransfersTest-958456871 None] Transfer volume completed successfully. Jun 02 00:39:51 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ae0fe9ae-487c-4532-a834-7160041592c9" returned: 0 in 0.672s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:51 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] Lock "cinder-quobyte-ae0fe9ae-487c-4532-a834-7160041592c9" released by "delete_volume" :: held 1.571s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:51 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] Created reservations ['7c90718e-9055-4fa6-a60c-e564c72c2fa1'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:39:51 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] Created reservations ['83704bbe-1ae0-484c-bb39-144ea17aadb6', '5a27cd54-9c27-42c0-879e-54e22c9e9d52', '26860c5e-0e5e-46b2-8ee5-ef024ea3c8f1', '08328976-e768-415a-8f7d-bb60f0b8027d'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:39:51 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.840s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:51 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:39:51 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] Deleted volume successfully. Jun 02 00:39:51 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:39:51 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:51 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d63f739b-52b7-4bd7-96ed-8cae1dfbfe2a tempest-VolumesTransfersV357Test-265540034 None] Lock "cinder-2862ee44-7971-4308-867f-0deed4c11084-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:52 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] Acquiring lock "cinder-3c69b9ee-2c6a-4384-90e9-ca23d17324f1-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:52 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] Lock "cinder-3c69b9ee-2c6a-4384-90e9-ca23d17324f1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:52 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.761s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:52 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:39:52 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f145608a-0413-428c-9a44-378596fdb699 tempest-GroupsV314Test-1595069850 None] Delete group completed successfully. Jun 02 00:39:52 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] Acquiring lock "cinder-quobyte-3c69b9ee-2c6a-4384-90e9-ca23d17324f1" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:52 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] Lock "cinder-quobyte-3c69b9ee-2c6a-4384-90e9-ca23d17324f1" acquired by "delete_volume" :: waited 0.022s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:52 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[15316cfb-1188-438e-856a-53e8115312c5]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3c69b9ee-2c6a-4384-90e9-ca23d17324f1 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:52 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3c69b9ee-2c6a-4384-90e9-ca23d17324f1 Jun 02 00:39:52 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:53 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3c69b9ee-2c6a-4384-90e9-ca23d17324f1" returned: 0 in 0.805s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3c69b9ee-2c6a-4384-90e9-ca23d17324f1 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:53 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3c69b9ee-2c6a-4384-90e9-ca23d17324f1 Jun 02 00:39:53 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:53 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3c69b9ee-2c6a-4384-90e9-ca23d17324f1" returned: 0 in 0.668s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:53 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] Lock "cinder-quobyte-3c69b9ee-2c6a-4384-90e9-ca23d17324f1" released by "delete_volume" :: held 1.528s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:53 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] Created reservations ['1fdfa3e0-412b-46f3-92dd-1e8045a584d6', 'db3e48d5-b9e1-46b4-ad9f-724440a7c5be', '4dc02340-380b-4c2c-990e-b08479339438', '74174a1e-712c-4754-b981-1e2625fc8941'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:39:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:54 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:39:54 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:54 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.649s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:54 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:39:54 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] Deleted volume successfully. Jun 02 00:39:54 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f123c051-15e4-4cb3-ae0a-913b1b87b94f tempest-VolumesTransfersTest-1323227157 None] Lock "cinder-3c69b9ee-2c6a-4384-90e9-ca23d17324f1-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Flow 'volume_create_manager' (3e5f95eb-c325-4f5a-810d-7ae41cd634ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ffe3e0-736b-4367-a884-6670d25e8b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ffe3e0-736b-4367-a884-6670d25e8b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1710559999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419d0c95-e166-493c-9cd2-e533b6864258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547e4711caa343eead404a113792d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:55Z,use_quota=True,user_id='4e0662c80d104e88893f1520ede8447a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f777462-01e4-4b1a-ad5d-d05c1f3b7a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f777462-01e4-4b1a-ad5d-d05c1f3b7a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6727e6c2-6330-4ea9-ae8b-78adf1cf370f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6727e6c2-6330-4ea9-ae8b-78adf1cf370f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419d0c95-e166-493c-9cd2-e533b6864258', 'volume_name': 'volume-419d0c95-e166-493c-9cd2-e533b6864258', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e842505-7bd6-4bc4-af15-9bc84574294e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e842505-7bd6-4bc4-af15-9bc84574294e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afd0e81-15a4-4a39-9f04-d3d61742d43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:55 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Volume 419d0c95-e166-493c-9cd2-e533b6864258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419d0c95-e166-493c-9cd2-e533b6864258', 'volume_size': 1} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1710559999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419d0c95-e166-493c-9cd2-e533b6864258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547e4711caa343eead404a113792d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:55Z,use_quota=True,user_id='4e0662c80d104e88893f1520ede8447a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Creating volume 419d0c95-e166-493c-9cd2-e533b6864258 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:39:55 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:39:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-419d0c95-e166-493c-9cd2-e533b6864258 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:55 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-419d0c95-e166-493c-9cd2-e533b6864258 1073741824 Jun 02 00:39:55 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:56 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-419d0c95-e166-493c-9cd2-e533b6864258 1073741824" returned: 0 in 1.322s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-419d0c95-e166-493c-9cd2-e533b6864258 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:56 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-419d0c95-e166-493c-9cd2-e533b6864258 Jun 02 00:39:56 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:57 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Jun 02 00:39:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-419d0c95-e166-493c-9cd2-e533b6864258" returned: 0 in 0.829s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:39:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] <== create_volume: return (2278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:39:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.281s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afd0e81-15a4-4a39-9f04-d3d61742d43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419d0c95-e166-493c-9cd2-e533b6864258', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ef44d8-852e-44bc-ad6f-8cc05befc446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:57 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Volume volume-419d0c95-e166-493c-9cd2-e533b6864258 (419d0c95-e166-493c-9cd2-e533b6864258): created successfully Jun 02 00:39:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ef44d8-852e-44bc-ad6f-8cc05befc446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Flow 'volume_create_manager' (3e5f95eb-c325-4f5a-810d-7ae41cd634ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:57 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-746d4a53-a8d4-4332-aa61-6b601cd657d9 tempest-VolumesTransfersTest-273007540 None] Created volume successfully. Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Flow 'volume_create_manager' (add031ba-6018-43ed-8f06-1f6cb65cacba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a874405a-2975-4db4-a414-8865b1d10a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a874405a-2975-4db4-a414-8865b1d10a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-344507293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34ee1aa-e973-490d-8f5f-4fc58da2bfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4c1bb6c2f0491bacd05505ff2c71b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:59Z,use_quota=True,user_id='95b22100b47547e984757c63c562d217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058d33d5-1994-4226-90b7-f4e9d9041024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058d33d5-1994-4226-90b7-f4e9d9041024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971db18c-e973-4610-bd7d-b85d1946073b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971db18c-e973-4610-bd7d-b85d1946073b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd34ee1aa-e973-490d-8f5f-4fc58da2bfa9', 'volume_name': 'volume-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9', 'volume_size': 2}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d923589-682b-47ce-a9a7-abbfeb0dd820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d923589-682b-47ce-a9a7-abbfeb0dd820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ec622d-2328-4339-bdb0-75218390adca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:39:59 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Volume d34ee1aa-e973-490d-8f5f-4fc58da2bfa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9', 'volume_size': 2} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-344507293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34ee1aa-e973-490d-8f5f-4fc58da2bfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4c1bb6c2f0491bacd05505ff2c71b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:39:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:39:59Z,use_quota=True,user_id='95b22100b47547e984757c63c562d217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Creating volume d34ee1aa-e973-490d-8f5f-4fc58da2bfa9 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:39:59 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9 2147483648 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:59 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9 2147483648 Jun 02 00:39:59 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] Acquiring lock "cinder-419d0c95-e166-493c-9cd2-e533b6864258-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] Lock "cinder-419d0c95-e166-493c-9cd2-e533b6864258-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] Acquiring lock "cinder-quobyte-419d0c95-e166-493c-9cd2-e533b6864258" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] Lock "cinder-quobyte-419d0c95-e166-493c-9cd2-e533b6864258" acquired by "delete_volume" :: waited 0.039s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f8eafe-7417-45e9-b1fc-f55ad3b127e3]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:39:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-419d0c95-e166-493c-9cd2-e533b6864258 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:39:59 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-419d0c95-e166-493c-9cd2-e533b6864258 Jun 02 00:39:59 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:00 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-419d0c95-e166-493c-9cd2-e533b6864258" returned: 0 in 0.787s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-419d0c95-e166-493c-9cd2-e533b6864258 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:00 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-419d0c95-e166-493c-9cd2-e533b6864258 Jun 02 00:40:00 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:00 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9 2147483648" returned: 0 in 1.107s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:00 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9 Jun 02 00:40:00 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:00 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-419d0c95-e166-493c-9cd2-e533b6864258" returned: 0 in 0.729s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] Lock "cinder-quobyte-419d0c95-e166-493c-9cd2-e533b6864258" released by "delete_volume" :: held 1.598s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:00 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9" returned: 0 in 0.672s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:40:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:01 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] Created reservations ['d34e10bd-e8d9-48c4-a527-a12d1e600dac', '6052f29c-dd48-4a2f-96fe-9d01c04c25de', '23be8110-54ab-46ef-b4aa-2fee7efa7c6a', 'b5c7c090-964a-40e5-af57-034fff96faea'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:40:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ec622d-2328-4339-bdb0-75218390adca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9', 'volume_size': 2}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b814069b-d2c3-4d1f-82d4-31e988de5ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:01 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Volume volume-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9 (d34ee1aa-e973-490d-8f5f-4fc58da2bfa9): created successfully Jun 02 00:40:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b814069b-d2c3-4d1f-82d4-31e988de5ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Flow 'volume_create_manager' (add031ba-6018-43ed-8f06-1f6cb65cacba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:40:01 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-25e5e431-a00f-4db6-8a85-0456d2160689 tempest-VolumesCloneNegativeTest-661892091 None] Created volume successfully. Jun 02 00:40:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:01 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:40:01 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:01 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.667s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:01 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:40:01 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] Deleted volume successfully. Jun 02 00:40:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3029166a-e0e1-471e-8e04-acc1f4b00093 tempest-VolumesTransfersTest-1323227157 None] Lock "cinder-419d0c95-e166-493c-9cd2-e533b6864258-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] Acquiring lock "cinder-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] Lock "cinder-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] Acquiring lock "cinder-quobyte-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] Lock "cinder-quobyte-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9" acquired by "delete_volume" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:02 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa44a7c-4b30-4ca5-9204-dfcd24cd6253]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:02 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9 Jun 02 00:40:02 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:03 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9" returned: 0 in 1.001s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:03 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9 Jun 02 00:40:03 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:04 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9" returned: 0 in 1.245s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] Lock "cinder-quobyte-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9" released by "delete_volume" :: held 2.319s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:04 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] Created reservations ['8c181b12-c29a-494c-b662-459b89299dc2', '67cce675-6c55-4fd4-9b88-abcf884d43a1', '32ebc19f-779d-49fc-a94f-545adca67ed5', '834de6fa-b5dd-4588-81be-11a719cc5818'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:40:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:05 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:40:05 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:06 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.396s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:06 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:40:06 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] Deleted volume successfully. Jun 02 00:40:06 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36c0a89e-3f86-40e1-8178-08497ffec650 tempest-VolumesCloneNegativeTest-661892091 None] Lock "cinder-d34ee1aa-e973-490d-8f5f-4fc58da2bfa9-delete_volume" released by "delete_volume" :: held 4.111s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Flow 'volume_create_manager' (88be4284-3b4f-44bb-9bb4-1e2d787f80a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27cb4011-3520-428a-ac77-7ba06789e373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27cb4011-3520-428a-ac77-7ba06789e373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1817620535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e569fa9-51c3-4f49-a170-e3b5419ab19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b8ad3d449240409f0e56315089fc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:40:11Z,use_quota=True,user_id='f6932e0788074d329df26f3458c14097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e39e28-30f6-4e8a-9892-ad701be9b27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e39e28-30f6-4e8a-9892-ad701be9b27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcbe829-6386-475f-9248-a987d598943e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcbe829-6386-475f-9248-a987d598943e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e569fa9-51c3-4f49-a170-e3b5419ab19f', 'volume_name': 'volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b09a53-f130-437f-a3b4-81602a849697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b09a53-f130-437f-a3b4-81602a849697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8659250c-a035-4b13-b25f-78b4f7c7c430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:10 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Volume 4e569fa9-51c3-4f49-a170-e3b5419ab19f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f', 'volume_size': 1} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1817620535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e569fa9-51c3-4f49-a170-e3b5419ab19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b8ad3d449240409f0e56315089fc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:40:11Z,use_quota=True,user_id='f6932e0788074d329df26f3458c14097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Creating volume 4e569fa9-51c3-4f49-a170-e3b5419ab19f {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:40:10 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:40:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:10 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f 1073741824 Jun 02 00:40:10 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:11 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f 1073741824" returned: 0 in 0.998s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:12 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f Jun 02 00:40:12 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:12 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:40:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Flow 'volume_create_manager' (f922950b-c87f-4d9c-89f3-db70f3f482a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:40:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8500a4b0-9090-4417-a31a-697f1faf2101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8500a4b0-9090-4417-a31a-697f1faf2101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2060984212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f7d7eb-2aba-4ca8-bd12-08edb1826697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f9d5e2a9a4436fa3e59e19cd68edcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:40:12Z,use_quota=True,user_id='2e1b7ed554b346f583fffd3ff33b7eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1627b24f-9eb7-46a2-aa3c-7099892375dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1627b24f-9eb7-46a2-aa3c-7099892375dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf1d269-1219-489b-a233-a763382f2888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:12 devstack cinder-volume[86910]: DEBUG cinder.image.glance [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Creating Keystone auth plugin from conf {{(pid=86910) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 00:40:13 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f" returned: 0 in 1.016s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:40:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8659250c-a035-4b13-b25f-78b4f7c7c430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe80db86-8380-42ba-91da-cca2300874ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:13 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Volume volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f (4e569fa9-51c3-4f49-a170-e3b5419ab19f): created successfully Jun 02 00:40:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe80db86-8380-42ba-91da-cca2300874ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Flow 'volume_create_manager' (88be4284-3b4f-44bb-9bb4-1e2d787f80a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:40:13 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f5a6f19a-a534-43bd-a1b3-6e30e28419d2 tempest-VolumesCloneTest-358686070 None] Created volume successfully. Jun 02 00:40:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf1d269-1219-489b-a233-a763382f2888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '48f7d7eb-2aba-4ca8-bd12-08edb1826697', 'volume_name': 'volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697', 'volume_size': 1, 'image_id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '213591b260fd4db58e9aae1daeaec391', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'created_at': datetime.datetime(2026, 6, 1, 22, 25, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 25, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b93abc4-d162-4478-b919-a527963e0e4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2bab56-b60d-4aae-a2aa-db14d1b51269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2bab56-b60d-4aae-a2aa-db14d1b51269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf7d8e3-e9d0-4a69-a7a8-a407f602958b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:13 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Volume 48f7d7eb-2aba-4ca8-bd12-08edb1826697: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697', 'volume_size': 1, 'image_id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '213591b260fd4db58e9aae1daeaec391', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'created_at': datetime.datetime(2026, 6, 1, 22, 25, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 25, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b93abc4-d162-4478-b919-a527963e0e4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 02 00:40:13 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Trying to clone 48f7d7eb-2aba-4ca8-bd12-08edb1826697 from image 1b93abc4-d162-4478-b919-a527963e0e4e at location (None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}]). {{(pid=86910) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 00:40:13 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_82tx56f6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 00:40:13 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Image download 20.69 MB at 20.69 MB/s Jun 02 00:40:13 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[818aa304-2ec3-49fa-a8f0-8ada1e3c74b5]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_82tx56f6devstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:13 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_82tx56f6devstack@QuobyteHD Jun 02 00:40:13 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:14 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_82tx56f6devstack@QuobyteHD" returned: 0 in 0.930s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Temporary image 1b93abc4-d162-4478-b919-a527963e0e4e is fetched for user 2e1b7ed554b346f583fffd3ff33b7eec. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fbd5dd-7f3b-4722-b6ad-58b998c6b5df]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_82tx56f6devstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Flow 'volume_create_manager' (351c85f1-3164-43a3-9023-1e374fc51f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323cc871-a9b5-445b-98e8-83c89bf79e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323cc871-a9b5-445b-98e8-83c89bf79e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1907693368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990f2f62-4e05-4cfc-b85a-6da0891e9427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b8ad3d449240409f0e56315089fc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:40:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4e569fa9-51c3-4f49-a170-e3b5419ab19f,status='creating',terminated_at=None,updated_at=2026-06-01T22:40:15Z,use_quota=True,user_id='f6932e0788074d329df26f3458c14097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab2ee3d-25f7-492d-b78c-3a5d6338c578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab2ee3d-25f7-492d-b78c-3a5d6338c578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:14 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_82tx56f6devstack@QuobyteHD Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e921eeae-4a3c-4bcd-99eb-3bb4fc1ca9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:14 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e921eeae-4a3c-4bcd-99eb-3bb4fc1ca9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '990f2f62-4e05-4cfc-b85a-6da0891e9427', 'volume_name': 'volume-990f2f62-4e05-4cfc-b85a-6da0891e9427', 'volume_size': 2, 'source_volid': '4e569fa9-51c3-4f49-a170-e3b5419ab19f', 'source_volstatus': 'available'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d99abd4-f173-4304-a9c7-f261bfa68dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d99abd4-f173-4304-a9c7-f261bfa68dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1759512-88c2-4995-80a4-7c5bde805ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:14 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Volume 990f2f62-4e05-4cfc-b85a-6da0891e9427: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-990f2f62-4e05-4cfc-b85a-6da0891e9427', 'volume_size': 2, 'source_volid': '4e569fa9-51c3-4f49-a170-e3b5419ab19f', 'source_volstatus': 'available'} Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:14 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Cloning volume 4e569fa9-51c3-4f49-a170-e3b5419ab19f to volume 990f2f62-4e05-4cfc-b85a-6da0891e9427 Jun 02 00:40:14 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Creating offline snapshot 466d46c3-8efd-46e8-b6c3-0531bd35b3ad of volume 4e569fa9-51c3-4f49-a170-e3b5419ab19f {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:40:15 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebd13e4-73cf-4d3c-97f3-6b0cea7b1a69]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:15 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f Jun 02 00:40:15 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:40:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:15 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:40:15 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:15 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_82tx56f6devstack@QuobyteHD" returned: 0 in 0.983s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:15 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f" returned: 0 in 0.982s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:16 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad 1G Jun 02 00:40:16 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:16 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.934s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:16 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:40:16 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad 1G" returned: 0 in 0.883s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:16 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad Jun 02 00:40:16 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:17 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad" returned: 0 in 0.700s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:17 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad is being set with open permissions: ugo+rw Jun 02 00:40:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:17 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad Jun 02 00:40:17 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:18 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad" returned: 0 in 0.621s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:18 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.info Jun 02 00:40:18 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:18 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.info" returned: 0 in 0.599s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:18 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.info is being set with open permissions: ugo+rw Jun 02 00:40:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:18 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.info Jun 02 00:40:18 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:40:19 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Flow 'volume_create_manager' (753222bc-eff2-468b-b6cf-8a496d5874be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20dbed5-efcb-4e07-b96d-238a4b27ddc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.info" returned: 0 in 0.625s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Acquiring lock "cinder-quobyte-990f2f62-4e05-4cfc-b85a-6da0891e9427" by "_copy_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20dbed5-efcb-4e07-b96d-238a4b27ddc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1848961783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a076f266-6bb7-4de1-82bf-13a3a9cef3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfba4f3fca6b4a6cb8fe62201e79efd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:40:19Z,use_quota=True,user_id='620b195e2e384c52a2d51f7eafcee7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7d98a2-7bbf-4ac1-808c-23885769f2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7d98a2-7bbf-4ac1-808c-23885769f2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b8bfcea-98cd-4dee-9534-e5d926712fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b8bfcea-98cd-4dee-9534-e5d926712fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a076f266-6bb7-4de1-82bf-13a3a9cef3c6', 'volume_name': 'volume-a076f266-6bb7-4de1-82bf-13a3a9cef3c6', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7b4dea-089b-4aa3-b951-4726ee2eb7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7b4dea-089b-4aa3-b951-4726ee2eb7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0213c634-a089-4fdf-be47-060f032c5770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:19 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Volume a076f266-6bb7-4de1-82bf-13a3a9cef3c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a076f266-6bb7-4de1-82bf-13a3a9cef3c6', 'volume_size': 1} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Lock "cinder-quobyte-990f2f62-4e05-4cfc-b85a-6da0891e9427" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] snapshot: 466d46c3-8efd-46e8-b6c3-0531bd35b3ad, volume: 990f2f62-4e05-4cfc-b85a-6da0891e9427, {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f52611-37dd-495f-b76b-9981c86f92bd]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:19 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad Jun 02 00:40:19 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:20 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad" returned: 0 in 0.689s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:20 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:40:20 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 00:40:20 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Creating direct copy from snapshot {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 00:40:20 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a169f76-6985-41e1-87a3-f113a9c8e0c4]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:20 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f Jun 02 00:40:20 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:20 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f" returned: 0 in 0.682s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:20 devstack cinder-volume[86910]: DEBUG cinder.utils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Path /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-990f2f62-4e05-4cfc-b85a-6da0891e9427 not found in is_blk_device check {{(pid=86910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 00:40:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-990f2f62-4e05-4cfc-b85a-6da0891e9427 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:20 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-990f2f62-4e05-4cfc-b85a-6da0891e9427 Jun 02 00:40:20 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:25 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-990f2f62-4e05-4cfc-b85a-6da0891e9427" returned: 0 in 4.968s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:25 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c9ec25-f656-4307-840a-c2cd300086c6]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:26 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f Jun 02 00:40:26 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:26 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f" returned: 0 in 0.883s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:26 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Image conversion details: src /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-990f2f62-4e05-4cfc-b85a-6da0891e9427 {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:40:26 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Converted 1024.00 MB image at 206.06 MB/s Jun 02 00:40:26 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-990f2f62-4e05-4cfc-b85a-6da0891e9427 is being set with open permissions: ugo+rw Jun 02 00:40:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-990f2f62-4e05-4cfc-b85a-6da0891e9427 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:26 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-990f2f62-4e05-4cfc-b85a-6da0891e9427 Jun 02 00:40:26 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:27 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-990f2f62-4e05-4cfc-b85a-6da0891e9427" returned: 0 in 0.580s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Lock "cinder-quobyte-990f2f62-4e05-4cfc-b85a-6da0891e9427" released by "_copy_volume_from_snapshot" :: held 7.878s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Acquiring lock "cinder-quobyte-466d46c3-8efd-46e8-b6c3-0531bd35b3ad" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Lock "cinder-quobyte-466d46c3-8efd-46e8-b6c3-0531bd35b3ad" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Deleting offline snapshot 466d46c3-8efd-46e8-b6c3-0531bd35b3ad of volume 4e569fa9-51c3-4f49-a170-e3b5419ab19f {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:40:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] snapshot_file for this snap is: volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:40:27 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c951641b-3630-4b34-a4a9-00ac0e5f0df0]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:27 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad Jun 02 00:40:27 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:28 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad" returned: 0 in 0.679s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:40:28 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[733f8ce2-e303-41e6-b554-4604a4cb8bd2]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:28 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f Jun 02 00:40:28 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:28 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f" returned: 0 in 0.725s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:28 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad Jun 02 00:40:28 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:29 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=52,cinder:UPDATE=75,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:40:29 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad" returned: 0 in 0.863s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:29 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad Jun 02 00:40:29 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:30 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f.466d46c3-8efd-46e8-b6c3-0531bd35b3ad" returned: 0 in 0.884s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Lock "cinder-quobyte-466d46c3-8efd-46e8-b6c3-0531bd35b3ad" released by "_delete_snapshot" :: held 3.277s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.815s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.062s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2060984212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f7d7eb-2aba-4ca8-bd12-08edb1826697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f9d5e2a9a4436fa3e59e19cd68edcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:40:12Z,use_quota=True,user_id='2e1b7ed554b346f583fffd3ff33b7eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:40:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Creating volume 48f7d7eb-2aba-4ca8-bd12-08edb1826697 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:40:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:40:30 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:40:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:30 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 1073741824 Jun 02 00:40:30 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1759512-88c2-4995-80a4-7c5bde805ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-990f2f62-4e05-4cfc-b85a-6da0891e9427', 'volume_size': 2, 'source_volid': '4e569fa9-51c3-4f49-a170-e3b5419ab19f', 'source_volstatus': 'available'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd60bade-29af-46aa-b3b0-bf877e91f3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:30 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Volume volume-990f2f62-4e05-4cfc-b85a-6da0891e9427 (990f2f62-4e05-4cfc-b85a-6da0891e9427): created successfully Jun 02 00:40:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd60bade-29af-46aa-b3b0-bf877e91f3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Flow 'volume_create_manager' (351c85f1-3164-43a3-9023-1e374fc51f0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:40:30 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-375beccb-a053-44f2-bc37-7a8f237eab6c tempest-VolumesCloneTest-358686070 None] Created volume successfully. Jun 02 00:40:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] Acquiring lock "cinder-990f2f62-4e05-4cfc-b85a-6da0891e9427-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] Lock "cinder-990f2f62-4e05-4cfc-b85a-6da0891e9427-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] Acquiring lock "cinder-quobyte-990f2f62-4e05-4cfc-b85a-6da0891e9427" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] Lock "cinder-quobyte-990f2f62-4e05-4cfc-b85a-6da0891e9427" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:31 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0d8479-4aad-4d0c-ad02-d8aeb1d0e573]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-990f2f62-4e05-4cfc-b85a-6da0891e9427 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:31 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-990f2f62-4e05-4cfc-b85a-6da0891e9427 Jun 02 00:40:31 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:31 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 1073741824" returned: 0 in 1.013s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:31 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 Jun 02 00:40:31 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:32 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-990f2f62-4e05-4cfc-b85a-6da0891e9427" returned: 0 in 0.840s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-990f2f62-4e05-4cfc-b85a-6da0891e9427 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:32 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-990f2f62-4e05-4cfc-b85a-6da0891e9427 Jun 02 00:40:32 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:32 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697" returned: 0 in 0.713s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.022s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1848961783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a076f266-6bb7-4de1-82bf-13a3a9cef3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfba4f3fca6b4a6cb8fe62201e79efd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:40:19Z,use_quota=True,user_id='620b195e2e384c52a2d51f7eafcee7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Creating volume a076f266-6bb7-4de1-82bf-13a3a9cef3c6 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:40:32 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a076f266-6bb7-4de1-82bf-13a3a9cef3c6 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:32 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a076f266-6bb7-4de1-82bf-13a3a9cef3c6 1073741824 Jun 02 00:40:32 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Attempting download of 1b93abc4-d162-4478-b919-a527963e0e4e ((None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}])) to volume 48f7d7eb-2aba-4ca8-bd12-08edb1826697. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe75be0-f569-41de-b7d7-98bf59f2ab79]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_kt9oa08q {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:32 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_kt9oa08q Jun 02 00:40:32 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:32 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-990f2f62-4e05-4cfc-b85a-6da0891e9427" returned: 0 in 0.652s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:32 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] Lock "cinder-quobyte-990f2f62-4e05-4cfc-b85a-6da0891e9427" released by "delete_volume" :: held 1.541s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] Created reservations ['4aaace82-af82-42d5-85a8-f4b6d40d6862', '56d4dad5-d07b-42ae-b0ad-48a4f87af3fc', '58bcef78-15d7-419a-96b2-b53f067a1cfb', '53465741-9abf-49ba-b551-8d58069b898a'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:33 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:40:33 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:33 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_kt9oa08q" returned: 0 in 0.729s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_kt9oa08q {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:33 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a076f266-6bb7-4de1-82bf-13a3a9cef3c6 1073741824" returned: 0 in 0.869s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a076f266-6bb7-4de1-82bf-13a3a9cef3c6 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:33 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a076f266-6bb7-4de1-82bf-13a3a9cef3c6 Jun 02 00:40:33 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:33 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_kt9oa08q Jun 02 00:40:33 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] Acquiring lock "cinder-4e569fa9-51c3-4f49-a170-e3b5419ab19f-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] Lock "cinder-4e569fa9-51c3-4f49-a170-e3b5419ab19f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] Acquiring lock "cinder-quobyte-4e569fa9-51c3-4f49-a170-e3b5419ab19f" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] Lock "cinder-quobyte-4e569fa9-51c3-4f49-a170-e3b5419ab19f" acquired by "delete_volume" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:33 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.710s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:40:33 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] Deleted volume successfully. Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a02a12-9c28-481d-9844-b5ee38ce181c]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:33 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5e7c2ae5-409a-41b5-8010-fe70a1657989 tempest-VolumesCloneTest-358686070 None] Lock "cinder-990f2f62-4e05-4cfc-b85a-6da0891e9427-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:33 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f Jun 02 00:40:33 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:34 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_kt9oa08q" returned: 1 in 0.768s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_kt9oa08q' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b3638b-591a-4b6a-9ca0-8b20e686ed3e]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_82tx56f6devstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:34 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a076f266-6bb7-4de1-82bf-13a3a9cef3c6" returned: 0 in 0.796s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:34 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_82tx56f6devstack@QuobyteHD Jun 02 00:40:34 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0213c634-a089-4fdf-be47-060f032c5770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a076f266-6bb7-4de1-82bf-13a3a9cef3c6', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce8cb9c-60d7-4ab0-87fd-f5031581da44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:34 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Volume volume-a076f266-6bb7-4de1-82bf-13a3a9cef3c6 (a076f266-6bb7-4de1-82bf-13a3a9cef3c6): created successfully Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce8cb9c-60d7-4ab0-87fd-f5031581da44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Flow 'volume_create_manager' (753222bc-eff2-468b-b6cf-8a496d5874be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:40:34 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-1d4b8faa-dffc-4f73-8f89-0af21cf0335d tempest-VolumeQuotasAdminTestJSON-1832948424 None] Created volume successfully. Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] Acquiring lock "cinder-a076f266-6bb7-4de1-82bf-13a3a9cef3c6-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] Lock "cinder-a076f266-6bb7-4de1-82bf-13a3a9cef3c6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] Acquiring lock "cinder-quobyte-a076f266-6bb7-4de1-82bf-13a3a9cef3c6" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] Lock "cinder-quobyte-a076f266-6bb7-4de1-82bf-13a3a9cef3c6" acquired by "delete_volume" :: waited 0.023s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[682f2a84-723a-4e88-9a96-6c40d9ac0cb0]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a076f266-6bb7-4de1-82bf-13a3a9cef3c6 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:34 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f" returned: 0 in 0.897s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:34 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f Jun 02 00:40:34 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:34 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a076f266-6bb7-4de1-82bf-13a3a9cef3c6 Jun 02 00:40:34 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:34 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_82tx56f6devstack@QuobyteHD" returned: 0 in 0.742s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] 1b93abc4-d162-4478-b919-a527963e0e4e was qcow2, converting to raw {{(pid=86910) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 00:40:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_82tx56f6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:34 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_82tx56f6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 Jun 02 00:40:34 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:35 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4e569fa9-51c3-4f49-a170-e3b5419ab19f" returned: 0 in 0.703s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] Lock "cinder-quobyte-4e569fa9-51c3-4f49-a170-e3b5419ab19f" released by "delete_volume" :: held 1.673s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:35 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a076f266-6bb7-4de1-82bf-13a3a9cef3c6" returned: 0 in 0.802s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a076f266-6bb7-4de1-82bf-13a3a9cef3c6 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:35 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a076f266-6bb7-4de1-82bf-13a3a9cef3c6 Jun 02 00:40:35 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:35 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] Created reservations ['d55694dd-1790-41a4-8c42-1e77ab343235', '943fccc2-54e1-4953-85ed-453b87fb4bf7', 'dcfb3d29-6aae-4afc-977a-56315bbbe95f', '090e853b-5c21-44c2-ae84-f6bcc2e09200'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:40:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:35 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:40:35 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:36 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a076f266-6bb7-4de1-82bf-13a3a9cef3c6" returned: 0 in 0.679s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] Lock "cinder-quobyte-a076f266-6bb7-4de1-82bf-13a3a9cef3c6" released by "delete_volume" :: held 1.522s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:36 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] Created reservations ['289efea2-913b-4843-843c-b7417554e938', '6469b51b-edbc-4f84-97b9-3ffc07bf04a3', '1434857a-5539-45a5-888f-86a106ae15af', '4a4767dd-8754-4b1a-8200-7f2d5180309a'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:40:36 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.729s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:36 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:40:36 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] Deleted volume successfully. Jun 02 00:40:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:36 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:36 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-07802a95-9049-4ebb-9474-0f98190562a4 tempest-VolumesCloneTest-358686070 None] Lock "cinder-4e569fa9-51c3-4f49-a170-e3b5419ab19f-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:36 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:40:36 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:37 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.804s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:40:37 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] Deleted volume successfully. Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a826c6f4-4154-4876-92f4-524a63b96993 tempest-VolumeQuotasAdminTestJSON-1832948424 None] Lock "cinder-a076f266-6bb7-4de1-82bf-13a3a9cef3c6-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:37 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_82tx56f6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697" returned: 0 in 2.419s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_82tx56f6devstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:40:37 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Converted 112.00 MB image at 46.28 MB/s Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:37 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 1G Jun 02 00:40:37 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Flow 'volume_create_manager' (dba2f643-91c7-482b-8896-ff092d94b16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9d5061-480a-43b4-a4c0-6c4c13b53a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9d5061-480a-43b4-a4c0-6c4c13b53a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-813284317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfba4f3fca6b4a6cb8fe62201e79efd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:40:37Z,use_quota=True,user_id='620b195e2e384c52a2d51f7eafcee7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf15b42-9508-4b64-87e5-d7d96b48fc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf15b42-9508-4b64-87e5-d7d96b48fc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b15deaa-69ce-4b86-a05b-70ed53dd8d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b15deaa-69ce-4b86-a05b-70ed53dd8d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf', 'volume_name': 'volume-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54f82d1-ea04-4a93-b42a-f10618245949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54f82d1-ea04-4a93-b42a-f10618245949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f65364-3fec-4440-8c80-c8677c1c335c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:37 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Volume f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf', 'volume_size': 1} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-813284317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfba4f3fca6b4a6cb8fe62201e79efd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:40:37Z,use_quota=True,user_id='620b195e2e384c52a2d51f7eafcee7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Creating volume f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:40:37 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:37 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf 1073741824 Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] Acquiring lock "cinder-3180e254-fa35-4c09-a26f-d2763aba866a-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:37 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "cinder-3180e254-fa35-4c09-a26f-d2763aba866a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=83,cinder:UPDATE=99,cinder:DELETE=6,cinder:INSERT=22 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] Acquiring lock "cinder-quobyte-3180e254-fa35-4c09-a26f-d2763aba866a" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "cinder-quobyte-3180e254-fa35-4c09-a26f-d2763aba866a" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[560ae984-6578-45cf-8d68-a44324d91e4b]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3180e254-fa35-4c09-a26f-d2763aba866a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:37 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3180e254-fa35-4c09-a26f-d2763aba866a Jun 02 00:40:37 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:38 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 1G" returned: 0 in 0.883s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:38 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ffe052-97fb-410c-b1d0-b0b9c6e68bd9]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:38 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 Jun 02 00:40:38 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:38 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf 1073741824" returned: 0 in 0.938s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:38 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3180e254-fa35-4c09-a26f-d2763aba866a" returned: 0 in 0.788s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3180e254-fa35-4c09-a26f-d2763aba866a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:38 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3180e254-fa35-4c09-a26f-d2763aba866a Jun 02 00:40:38 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:38 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf Jun 02 00:40:38 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:39 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697" returned: 0 in 0.867s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:39 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 Jun 02 00:40:39 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:39 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3180e254-fa35-4c09-a26f-d2763aba866a" returned: 0 in 0.705s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "cinder-quobyte-3180e254-fa35-4c09-a26f-d2763aba866a" released by "delete_volume" :: held 1.546s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:39 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf" returned: 0 in 0.744s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f65364-3fec-4440-8c80-c8677c1c335c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f63e0ff-258a-4d66-ba60-dc3e59bfe1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] Created reservations ['82b1db3e-85e6-4e26-8447-d44248a22317', '9e15aafa-b608-4daf-8a82-42acde20ebfe', 'dd4e69b7-dd1c-4392-843f-12daff684b43', 'd26ba5c2-7808-41f0-8b36-5cb4f816abb8'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:40:39 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Volume volume-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf (f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf): created successfully Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f63e0ff-258a-4d66-ba60-dc3e59bfe1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Flow 'volume_create_manager' (dba2f643-91c7-482b-8896-ff092d94b16d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:40:39 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-554e73d4-7113-4000-800b-7a7ba33e42ca tempest-VolumeQuotasAdminTestJSON-1832948424 None] Created volume successfully. Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:39 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:40:39 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:40 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697" returned: 1 in 0.984s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Downloaded image 1b93abc4-d162-4478-b919-a527963e0e4e ((None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}])) to volume 48f7d7eb-2aba-4ca8-bd12-08edb1826697 successfully. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Temporary image 1b93abc4-d162-4478-b919-a527963e0e4e for user 2e1b7ed554b346f583fffd3ff33b7eec is deleted. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Marking volume 48f7d7eb-2aba-4ca8-bd12-08edb1826697 as bootable. {{(pid=86910) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Copying metadata from image 1b93abc4-d162-4478-b919-a527963e0e4e to 48f7d7eb-2aba-4ca8-bd12-08edb1826697. {{(pid=86910) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Creating volume glance metadata for volume 48f7d7eb-2aba-4ca8-bd12-08edb1826697 backed by image 1b93abc4-d162-4478-b919-a527963e0e4e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86910) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] Acquiring lock "cinder-ab1c89ab-404d-4ddc-b867-9f4cd8b08152-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "cinder-ab1c89ab-404d-4ddc-b867-9f4cd8b08152-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf7d8e3-e9d0-4a69-a7a8-a407f602958b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697', 'volume_size': 1, 'image_id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '213591b260fd4db58e9aae1daeaec391', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'created_at': datetime.datetime(2026, 6, 1, 22, 25, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 25, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b93abc4-d162-4478-b919-a527963e0e4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f127897-9d36-43ad-b57c-36ad0ace1dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:40 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Volume volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 (48f7d7eb-2aba-4ca8-bd12-08edb1826697): created successfully Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f127897-9d36-43ad-b57c-36ad0ace1dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Flow 'volume_create_manager' (f922950b-c87f-4d9c-89f3-db70f3f482a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] Acquiring lock "cinder-quobyte-ab1c89ab-404d-4ddc-b867-9f4cd8b08152" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:40 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-38ba8436-60bd-44a8-81cd-7bd9f85c67b9 tempest-VolumesExtendTest-352541698 None] Created volume successfully. Jun 02 00:40:40 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.898s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "cinder-quobyte-ab1c89ab-404d-4ddc-b867-9f4cd8b08152" acquired by "delete_volume" :: waited 0.034s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:40 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] Deleted volume successfully. Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7311a3d-8942-4f2c-bc94-94c3191279cc]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d014d92c-237c-48ef-845f-12094a8806a8 tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "cinder-3180e254-fa35-4c09-a26f-d2763aba866a-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:40 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152 Jun 02 00:40:40 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:40 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e199d8fb-9534-4ef2-96d7-104e48955bd7 tempest-VolumeQuotasAdminTestJSON-225811477 None] Transfer volume completed successfully. Jun 02 00:40:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-42381167-4c77-4f9a-a4e5-b1d382b899e6 tempest-VolumesExtendTest-352541698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-42381167-4c77-4f9a-a4e5-b1d382b899e6 tempest-VolumesExtendTest-352541698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:41 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2060e198-d360-420f-9d73-e053198ccbad]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-42381167-4c77-4f9a-a4e5-b1d382b899e6 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:41 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152" returned: 0 in 0.819s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:41 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 Jun 02 00:40:41 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:41 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152 Jun 02 00:40:41 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] Acquiring lock "cinder-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] Lock "cinder-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] Acquiring lock "cinder-quobyte-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] Lock "cinder-quobyte-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf" acquired by "delete_volume" :: waited 0.020s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:42 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6697ca-f718-4a27-a690-c6d7bd0869aa]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:42 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ab1c89ab-404d-4ddc-b867-9f4cd8b08152" returned: 0 in 0.739s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "cinder-quobyte-ab1c89ab-404d-4ddc-b867-9f4cd8b08152" released by "delete_volume" :: held 1.628s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:42 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-42381167-4c77-4f9a-a4e5-b1d382b899e6 tempest-VolumesExtendTest-352541698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697" returned: 0 in 0.923s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-42381167-4c77-4f9a-a4e5-b1d382b899e6 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:42 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf Jun 02 00:40:42 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:42 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] Created reservations ['1fb76ee1-0f02-436a-b615-aa48114c82dc', '49d440a2-f78a-49e9-8658-1a2af012ff66', 'e089d3dd-01f2-4683-8669-2df22a0b13a3', 'c8989aac-4440-491c-b625-79ddea91238c'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:40:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:42 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:42 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:42 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:40:42 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:42 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 Jun 02 00:40:42 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:42 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf" returned: 0 in 0.936s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:42 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf Jun 02 00:40:42 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:43 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.778s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:40:43 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] Deleted volume successfully. Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-74451513-16e0-4f2d-a279-c23b9e30e83c tempest-AttachVolumeShelveTestJSON-425694257 None] Lock "cinder-ab1c89ab-404d-4ddc-b867-9f4cd8b08152-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:43 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-42381167-4c77-4f9a-a4e5-b1d382b899e6 tempest-VolumesExtendTest-352541698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697" returned: 1 in 1.037s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-42381167-4c77-4f9a-a4e5-b1d382b899e6 tempest-VolumesExtendTest-352541698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-42381167-4c77-4f9a-a4e5-b1d382b899e6 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 2G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-42381167-4c77-4f9a-a4e5-b1d382b899e6 tempest-VolumesExtendTest-352541698 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 2G" returned: 0 in 0.069s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-42381167-4c77-4f9a-a4e5-b1d382b899e6 tempest-VolumesExtendTest-352541698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.089s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:43 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-42381167-4c77-4f9a-a4e5-b1d382b899e6 tempest-VolumesExtendTest-352541698 None] Extend volume completed successfully. Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Acquiring lock "cinder-48f7d7eb-2aba-4ca8-bd12-08edb1826697-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Lock "cinder-48f7d7eb-2aba-4ca8-bd12-08edb1826697-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Acquiring lock "cinder-quobyte-48f7d7eb-2aba-4ca8-bd12-08edb1826697" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Lock "cinder-quobyte-48f7d7eb-2aba-4ca8-bd12-08edb1826697" acquired by "delete_volume" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6fa5e3-4da6-4853-a478-948f778a093e]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:43 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf" returned: 0 in 0.842s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] Lock "cinder-quobyte-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf" released by "delete_volume" :: held 1.837s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] Created reservations ['49a7fada-7129-4431-af8b-24465d1d8394', '7340017f-9246-49a8-862e-f67aae3ec9e0', 'e0c771e1-d7ce-4c01-99be-e993df30c26e', 'd0389051-4cee-4e41-b71b-396ec897aeb0'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:40:43 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 Jun 02 00:40:43 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:43 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:40:43 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:44 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.819s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:44 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:40:44 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] Deleted volume successfully. Jun 02 00:40:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b13a834d-8076-4267-baf1-37d48a178b66 tempest-VolumeQuotasAdminTestJSON-1581749148 None] Lock "cinder-f0bf8f14-7d4f-41aa-8acc-42e9ebffe1cf-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:45 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697" returned: 0 in 1.256s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:45 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 Jun 02 00:40:45 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:45 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697" returned: 1 in 0.973s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:40:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:46 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697 Jun 02 00:40:46 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:46 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-48f7d7eb-2aba-4ca8-bd12-08edb1826697" returned: 0 in 0.713s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Lock "cinder-quobyte-48f7d7eb-2aba-4ca8-bd12-08edb1826697" released by "delete_volume" :: held 3.015s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:46 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Created reservations ['cbf9f859-0361-4a78-a2dd-5e22df60d4eb', 'e785c44a-ca59-47bf-9edd-cbcd0f77ede7', 'c8a9e311-d657-4acb-926b-7f03f774350c', '59e4d310-3224-49bc-b992-b29ff9880f02'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:40:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:46 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:40:46 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Flow 'volume_create_manager' (32f05f0d-e7ac-4af1-aaeb-211057aa7431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2f97ed-da11-49cc-a78f-75ed0893934e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2f97ed-da11-49cc-a78f-75ed0893934e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-662909430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693b00d5-ce9a-425a-bd54-3ea38a92d279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f9d5e2a9a4436fa3e59e19cd68edcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:40:48Z,use_quota=True,user_id='2e1b7ed554b346f583fffd3ff33b7eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e4b85a-8c1c-4b06-b0c1-d687d7b49b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e4b85a-8c1c-4b06-b0c1-d687d7b49b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:47 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57545ca1-dc5f-4ab8-ae15-95c255825cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57545ca1-dc5f-4ab8-ae15-95c255825cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '693b00d5-ce9a-425a-bd54-3ea38a92d279', 'volume_name': 'volume-693b00d5-ce9a-425a-bd54-3ea38a92d279', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b5fae9-b451-4e73-8bf1-c2720dc625b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b5fae9-b451-4e73-8bf1-c2720dc625b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4435fed4-7a88-4aa5-94f6-34b23bca9c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:47 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Volume 693b00d5-ce9a-425a-bd54-3ea38a92d279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-693b00d5-ce9a-425a-bd54-3ea38a92d279', 'volume_size': 1} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-662909430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693b00d5-ce9a-425a-bd54-3ea38a92d279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f9d5e2a9a4436fa3e59e19cd68edcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:40:48Z,use_quota=True,user_id='2e1b7ed554b346f583fffd3ff33b7eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Creating volume 693b00d5-ce9a-425a-bd54-3ea38a92d279 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:40:47 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.020s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:40:47 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Deleted volume successfully. Jun 02 00:40:47 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 1073741824 Jun 02 00:40:47 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fadc2c39-1689-4d1b-ad3e-6099fa321e2e tempest-VolumesExtendTest-352541698 None] Lock "cinder-48f7d7eb-2aba-4ca8-bd12-08edb1826697-delete_volume" released by "delete_volume" :: held 4.273s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:40:48 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 1073741824" returned: 0 in 1.029s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:48 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 Jun 02 00:40:48 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:49 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279" returned: 0 in 0.810s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:40:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4435fed4-7a88-4aa5-94f6-34b23bca9c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-693b00d5-ce9a-425a-bd54-3ea38a92d279', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa876b86-0dbf-4418-9608-1a86624ea66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:49 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Volume volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 (693b00d5-ce9a-425a-bd54-3ea38a92d279): created successfully Jun 02 00:40:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa876b86-0dbf-4418-9608-1a86624ea66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Flow 'volume_create_manager' (32f05f0d-e7ac-4af1-aaeb-211057aa7431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:40:49 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-9e3929e3-306e-44c6-ac1d-c1dd90bfe322 tempest-VolumesExtendTest-352541698 None] Created volume successfully. Jun 02 00:40:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] Creating offline snapshot 7c6fd80e-aeb6-4d03-8275-45e3eb644463 of volume 693b00d5-ce9a-425a-bd54-3ea38a92d279 {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:40:51 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f10437-5059-4070-bc77-9f26ee1691db]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:51 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 Jun 02 00:40:51 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:52 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279" returned: 0 in 1.014s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:52 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463 1G Jun 02 00:40:52 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:53 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463 1G" returned: 0 in 0.947s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:53 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463 Jun 02 00:40:53 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:54 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463" returned: 0 in 0.823s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:54 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463 is being set with open permissions: ugo+rw Jun 02 00:40:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:54 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463 Jun 02 00:40:54 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:54 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463" returned: 0 in 0.681s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:54 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.info Jun 02 00:40:54 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:55 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.info" returned: 0 in 0.803s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:55 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.info is being set with open permissions: ugo+rw Jun 02 00:40:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:55 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.info Jun 02 00:40:55 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Flow 'volume_create_manager' (f0628b57-e28c-4491-922f-2e72eddcc92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb31b81-e4e1-49f7-9601-ea9cd8c4c0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb31b81-e4e1-49f7-9601-ea9cd8c4c0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-241821968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5442e60d-2ccc-4e6b-994f-5c0660d5bba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e1714b070a4f4b9fb28987476e9cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:40:56Z,use_quota=True,user_id='d98b052700c94e01a2717fdc2beeef29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a274a997-f851-422a-ae87-68f08a237a80),volume_type_id=a274a997-f851-422a-ae87-68f08a237a80)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e65b9be-053b-47c6-9c71-402b1eb1d7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e65b9be-053b-47c6-9c71-402b1eb1d7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b145a8-ae39-4bf5-bda4-cc2fae6b432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b145a8-ae39-4bf5-bda4-cc2fae6b432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5442e60d-2ccc-4e6b-994f-5c0660d5bba8', 'volume_name': 'volume-5442e60d-2ccc-4e6b-994f-5c0660d5bba8', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdc183a-ccdb-4589-9bf8-d9ae12f5f9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdc183a-ccdb-4589-9bf8-d9ae12f5f9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff11754-8c20-44a9-a1ea-f84a62820677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:56 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Volume 5442e60d-2ccc-4e6b-994f-5c0660d5bba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5442e60d-2ccc-4e6b-994f-5c0660d5bba8', 'volume_size': 1} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:56 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.info" returned: 0 in 0.882s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.305s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-241821968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5442e60d-2ccc-4e6b-994f-5c0660d5bba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e1714b070a4f4b9fb28987476e9cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:40:56Z,use_quota=True,user_id='d98b052700c94e01a2717fdc2beeef29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a274a997-f851-422a-ae87-68f08a237a80),volume_type_id=a274a997-f851-422a-ae87-68f08a237a80)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Creating volume 5442e60d-2ccc-4e6b-994f-5c0660d5bba8 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:40:56 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:40:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5442e60d-2ccc-4e6b-994f-5c0660d5bba8 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:56 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e68c30a8-c7a8-498e-88a9-96453d87ce42 tempest-VolumesExtendTest-352541698 None] Create snapshot completed successfully Jun 02 00:40:56 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5442e60d-2ccc-4e6b-994f-5c0660d5bba8 1073741824 Jun 02 00:40:56 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:57 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5442e60d-2ccc-4e6b-994f-5c0660d5bba8 1073741824" returned: 0 in 1.018s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5442e60d-2ccc-4e6b-994f-5c0660d5bba8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:57 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5442e60d-2ccc-4e6b-994f-5c0660d5bba8 Jun 02 00:40:57 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-55e42daf-dfc1-47aa-8ce7-b6990558a331 tempest-VolumesExtendTest-352541698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:58 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5442e60d-2ccc-4e6b-994f-5c0660d5bba8" returned: 0 in 0.784s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:40:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-55e42daf-dfc1-47aa-8ce7-b6990558a331 tempest-VolumesExtendTest-352541698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.627s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff11754-8c20-44a9-a1ea-f84a62820677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5442e60d-2ccc-4e6b-994f-5c0660d5bba8', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21f5069-b733-452d-b4a5-cb39439f5d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:40:58 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f838a1a-84bf-4856-940a-a98991e5b8bf]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:40:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-55e42daf-dfc1-47aa-8ce7-b6990558a331 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:58 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Volume volume-5442e60d-2ccc-4e6b-994f-5c0660d5bba8 (5442e60d-2ccc-4e6b-994f-5c0660d5bba8): created successfully Jun 02 00:40:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21f5069-b733-452d-b4a5-cb39439f5d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:40:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Flow 'volume_create_manager' (f0628b57-e28c-4491-922f-2e72eddcc92c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:40:58 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-7bb0ab1d-4cde-4861-a561-1ef3d49c7a45 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Created volume successfully. Jun 02 00:40:58 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 Jun 02 00:40:58 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:40:59 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Jun 02 00:40:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-55e42daf-dfc1-47aa-8ce7-b6990558a331 tempest-VolumesExtendTest-352541698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279" returned: 0 in 0.906s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-55e42daf-dfc1-47aa-8ce7-b6990558a331 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463 2G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-55e42daf-dfc1-47aa-8ce7-b6990558a331 tempest-VolumesExtendTest-352541698 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463 2G" returned: 0 in 0.194s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:40:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-55e42daf-dfc1-47aa-8ce7-b6990558a331 tempest-VolumesExtendTest-352541698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.168s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:59 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-55e42daf-dfc1-47aa-8ce7-b6990558a331 tempest-VolumesExtendTest-352541698 None] Extend volume completed successfully. Jun 02 00:40:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-595b92b8-ff94-469a-80b6-3f853023d6f7 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:40:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-595b92b8-ff94-469a-80b6-3f853023d6f7 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:40:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-595b92b8-ff94-469a-80b6-3f853023d6f7 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:40:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-595b92b8-ff94-469a-80b6-3f853023d6f7 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:40:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-595b92b8-ff94-469a-80b6-3f853023d6f7 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:40:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-595b92b8-ff94-469a-80b6-3f853023d6f7 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:40:59 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:40:59 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] Acquiring lock "cinder-7c6fd80e-aeb6-4d03-8275-45e3eb644463-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] Lock "cinder-7c6fd80e-aeb6-4d03-8275-45e3eb644463-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] Acquiring lock "cinder-quobyte-693b00d5-ce9a-425a-bd54-3ea38a92d279" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] Lock "cinder-quobyte-693b00d5-ce9a-425a-bd54-3ea38a92d279" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] Acquiring lock "cinder-quobyte-7c6fd80e-aeb6-4d03-8275-45e3eb644463" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] Lock "cinder-quobyte-7c6fd80e-aeb6-4d03-8275-45e3eb644463" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] Deleting offline snapshot 7c6fd80e-aeb6-4d03-8275-45e3eb644463 of volume 693b00d5-ce9a-425a-bd54-3ea38a92d279 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:41:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] snapshot_file for this snap is: volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:41:00 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f7e399-d5d2-41ba-94e8-e4681c6ffe7d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:00 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463 Jun 02 00:41:00 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:00 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-595b92b8-ff94-469a-80b6-3f853023d6f7 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.823s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:00 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-595b92b8-ff94-469a-80b6-3f853023d6f7 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:41:00 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-595b92b8-ff94-469a-80b6-3f853023d6f7 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Retype volume completed successfully. Jun 02 00:41:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Acquiring lock "cinder-5442e60d-2ccc-4e6b-994f-5c0660d5bba8-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Lock "cinder-5442e60d-2ccc-4e6b-994f-5c0660d5bba8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:01 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463" returned: 0 in 0.855s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-693b00d5-ce9a-425a-bd54-3ea38a92d279(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:41:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Acquiring lock "cinder-quobyte-5442e60d-2ccc-4e6b-994f-5c0660d5bba8" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:01 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd6af8c-143a-425e-8607-b9bfedbb181f]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Lock "cinder-quobyte-5442e60d-2ccc-4e6b-994f-5c0660d5bba8" acquired by "delete_volume" :: waited 0.058s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:01 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce24554-5265-4e75-835a-dcca1859c0df]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5442e60d-2ccc-4e6b-994f-5c0660d5bba8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:01 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 Jun 02 00:41:01 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:01 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5442e60d-2ccc-4e6b-994f-5c0660d5bba8 Jun 02 00:41:01 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:02 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279" returned: 0 in 1.093s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:02 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463 Jun 02 00:41:02 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:02 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5442e60d-2ccc-4e6b-994f-5c0660d5bba8" returned: 0 in 1.135s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5442e60d-2ccc-4e6b-994f-5c0660d5bba8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:02 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5442e60d-2ccc-4e6b-994f-5c0660d5bba8 Jun 02 00:41:02 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:03 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463" returned: 0 in 0.869s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:03 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:03 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463 Jun 02 00:41:03 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5442e60d-2ccc-4e6b-994f-5c0660d5bba8" returned: 0 in 0.759s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Lock "cinder-quobyte-5442e60d-2ccc-4e6b-994f-5c0660d5bba8" released by "delete_volume" :: held 1.980s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:03 devstack cinder-volume[86910]: WARNING cinder.quota [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:41:03 devstack cinder-volume[86910]: WARNING cinder.quota [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:41:03 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Created reservations ['bc2729b1-6b33-42f6-ab25-592987fa8050', '82019386-0216-42d0-916a-ae475c13ad69', 'b9cc65d6-3e4a-4009-8c6e-ffefdeeb23a8', 'eb4fb10c-a624-46e3-960d-9f181658fb9c'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:41:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:03 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:03 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:03 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:41:03 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:03 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-bd954208-9e9e-49d0-a7e3-f937b7ababbf tempest-GroupsTest-586866301 None] Group tempest-Group1-1213574240: creating Jun 02 00:41:03 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-bd954208-9e9e-49d0-a7e3-f937b7ababbf tempest-GroupsTest-586866301 None] Group tempest-Group1-1213574240: created successfully Jun 02 00:41:03 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-bd954208-9e9e-49d0-a7e3-f937b7ababbf tempest-GroupsTest-586866301 None] Create group completed successfully. Jun 02 00:41:04 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279.7c6fd80e-aeb6-4d03-8275-45e3eb644463" returned: 0 in 0.704s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] Lock "cinder-quobyte-7c6fd80e-aeb6-4d03-8275-45e3eb644463" released by "_delete_snapshot" :: held 3.773s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] Lock "cinder-quobyte-693b00d5-ce9a-425a-bd54-3ea38a92d279" released by "delete_snapshot" :: held 3.803s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:04 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] Created reservations ['b38ab662-23ef-4f7f-9dc2-34048c3f1e2b', 'b9326b24-3c77-40e9-a0f4-0079311a9327', 'c8b6a80a-37db-4ee5-abb1-0cfd9cb47512', '3549846a-ef12-49c3-84e5-300525aa7094'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:41:04 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] Delete snapshot completed successfully. Jun 02 00:41:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-66719b00-31e5-49bb-8af0-157982ebbc03 tempest-VolumesExtendTest-352541698 None] Lock "cinder-7c6fd80e-aeb6-4d03-8275-45e3eb644463-delete_snapshot" released by "delete_snapshot" :: held 3.996s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:04 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.736s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:04 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:41:04 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Deleted volume successfully. Jun 02 00:41:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-79c5e6d5-6ef7-44d9-bac9-01609e885b62 tempest-VolumeRetypeWithoutMigrationTest-1381028538 None] Lock "cinder-5442e60d-2ccc-4e6b-994f-5c0660d5bba8-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] Acquiring lock "cinder-693b00d5-ce9a-425a-bd54-3ea38a92d279-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] Lock "cinder-693b00d5-ce9a-425a-bd54-3ea38a92d279-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] Acquiring lock "cinder-quobyte-693b00d5-ce9a-425a-bd54-3ea38a92d279" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] Lock "cinder-quobyte-693b00d5-ce9a-425a-bd54-3ea38a92d279" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:04 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f4549b-2bcc-43ea-93f2-ea786f5eb39b]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:05 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 Jun 02 00:41:05 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:05 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-79ee0795-06ec-4c03-827c-05ca44145c36 tempest-GroupsTest-586866301 None] Group tempest-Group2-10548966: creating Jun 02 00:41:05 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-79ee0795-06ec-4c03-827c-05ca44145c36 tempest-GroupsTest-586866301 None] Group tempest-Group2-10548966: created successfully Jun 02 00:41:05 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-79ee0795-06ec-4c03-827c-05ca44145c36 tempest-GroupsTest-586866301 None] Create group completed successfully. Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Flow 'volume_create_manager' (21233dce-5e20-43fb-8d31-013e4a22eab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e435c31f-439e-4062-a83e-598e5bae61f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e435c31f-439e-4062-a83e-598e5bae61f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-746973888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d11532-460a-4153-9fd3-75ffef8634c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5fdb187c6f437294d46d193aa08d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:06Z,use_quota=True,user_id='5fc70295770d42c988f8cb827ecc5b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9419a99a-19ac-476b-8ced-30c19621884d),volume_type_id=9419a99a-19ac-476b-8ced-30c19621884d)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8539ce06-24f1-4b2b-9713-593d2888412f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8539ce06-24f1-4b2b-9713-593d2888412f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1852cbea-3fa3-4f21-9316-ff4697d6f203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1852cbea-3fa3-4f21-9316-ff4697d6f203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d11532-460a-4153-9fd3-75ffef8634c4', 'volume_name': 'volume-21d11532-460a-4153-9fd3-75ffef8634c4', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f309e4-2cfa-4c36-ba38-0e7547b64ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f309e4-2cfa-4c36-ba38-0e7547b64ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac5f2f3-c107-4a2e-8a79-c6b51af287ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:05 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Volume 21d11532-460a-4153-9fd3-75ffef8634c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d11532-460a-4153-9fd3-75ffef8634c4', 'volume_size': 1} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-746973888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d11532-460a-4153-9fd3-75ffef8634c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5fdb187c6f437294d46d193aa08d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:06Z,use_quota=True,user_id='5fc70295770d42c988f8cb827ecc5b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9419a99a-19ac-476b-8ced-30c19621884d),volume_type_id=9419a99a-19ac-476b-8ced-30c19621884d)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Creating volume 21d11532-460a-4153-9fd3-75ffef8634c4 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:41:05 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:41:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-21d11532-460a-4153-9fd3-75ffef8634c4 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:05 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-21d11532-460a-4153-9fd3-75ffef8634c4 1073741824 Jun 02 00:41:05 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:06 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279" returned: 0 in 1.172s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:06 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279 Jun 02 00:41:06 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:06 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:41:06 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Flow 'volume_create_manager' (a403caee-5e45-4a02-89a4-13787b708074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:06 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ebee9b-0502-49d8-be3c-bf08359cb919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:06 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ebee9b-0502-49d8-be3c-bf08359cb919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-669090077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611b3974-a07c-4fba-b839-161f844a877f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5fdb187c6f437294d46d193aa08d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:06Z,use_quota=True,user_id='5fc70295770d42c988f8cb827ecc5b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea34b85f-15a1-41f3-903c-9e57ffd66374),volume_type_id=ea34b85f-15a1-41f3-903c-9e57ffd66374)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:06 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e6d70b-e013-404f-b504-58dc33e09eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:06 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e6d70b-e013-404f-b504-58dc33e09eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:06 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1241244f-0e28-44fc-b2d2-59c3cbf88c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:06 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1241244f-0e28-44fc-b2d2-59c3cbf88c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '611b3974-a07c-4fba-b839-161f844a877f', 'volume_name': 'volume-611b3974-a07c-4fba-b839-161f844a877f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:06 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4103d60-e281-466f-b300-58f75d936851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:06 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4103d60-e281-466f-b300-58f75d936851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:06 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b19256-30a0-4a92-a4b1-26f6f232fbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:06 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Volume 611b3974-a07c-4fba-b839-161f844a877f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-611b3974-a07c-4fba-b839-161f844a877f', 'volume_size': 1} Jun 02 00:41:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:06 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-21d11532-460a-4153-9fd3-75ffef8634c4 1073741824" returned: 0 in 1.226s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-21d11532-460a-4153-9fd3-75ffef8634c4 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:07 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-21d11532-460a-4153-9fd3-75ffef8634c4 Jun 02 00:41:07 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:41:07 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Flow 'volume_create_manager' (2f14304b-c89d-44db-812f-799ab779f5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52711747-8828-4f1c-8d2e-ae4d07a85f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-693b00d5-ce9a-425a-bd54-3ea38a92d279" returned: 0 in 1.089s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52711747-8828-4f1c-8d2e-ae4d07a85f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1482486124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f306f8-fc2b-4e08-bb9a-7138acf1a14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5fdb187c6f437294d46d193aa08d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:07Z,use_quota=True,user_id='5fc70295770d42c988f8cb827ecc5b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cc1475c-0113-4c16-9abd-4ca967fd95a5),volume_type_id=6cc1475c-0113-4c16-9abd-4ca967fd95a5)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a988c9dd-09de-4aa7-9180-cc5add3ff42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a988c9dd-09de-4aa7-9180-cc5add3ff42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf9f398-4ac9-4964-b656-234779fb8c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.image.glance [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Creating Keystone auth plugin from conf {{(pid=86910) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] Lock "cinder-quobyte-693b00d5-ce9a-425a-bd54-3ea38a92d279" released by "delete_volume" :: held 2.381s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Flow 'volume_create_manager' (4145622d-3243-44df-895a-ac2a020ac570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd39439-7d52-48b8-9f12-70b9db716d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd39439-7d52-48b8-9f12-70b9db716d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1717663911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e144500-b59c-485c-bbad-853b173dd677,host='devstack@QuobyteHD#QuobyteHD',id=b89b5049-c72a-477a-a769-67d4fbae78c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89acf76b620f43c5be873337c813bd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:07Z,use_quota=True,user_id='6629f76ced474035b9f204502ae89355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40a97043-57d4-450d-b99b-3490c58c5c90),volume_type_id=40a97043-57d4-450d-b99b-3490c58c5c90)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3703488-ff06-42f9-a5ad-3499e4c2bea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3703488-ff06-42f9-a5ad-3499e4c2bea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef035689-0e08-4c52-9b7f-c344017979cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef035689-0e08-4c52-9b7f-c344017979cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b89b5049-c72a-477a-a769-67d4fbae78c3', 'volume_name': 'volume-b89b5049-c72a-477a-a769-67d4fbae78c3', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e883da5a-82af-4525-8b95-8c5ed0b47c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e883da5a-82af-4525-8b95-8c5ed0b47c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ac3301-42b1-4462-a101-fe49c2f7f23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:07 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Volume b89b5049-c72a-477a-a769-67d4fbae78c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b89b5049-c72a-477a-a769-67d4fbae78c3', 'volume_size': 1} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] Created reservations ['f384518f-688d-4e1a-b6e7-b84d291ee7a4', 'a924d0c0-707a-447d-9fb2-87f209a4913e', '6458c515-2512-486c-a177-d44d3d678fd1', 'b02c6f0c-e9d8-4c79-afea-19f570f0d661'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:07 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:41:07 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf9f398-4ac9-4964-b656-234779fb8c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e6f306f8-fc2b-4e08-bb9a-7138acf1a14d', 'volume_name': 'volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d', 'volume_size': 1, 'image_id': 'edd7d792-7f72-4444-8362-ce24faa563f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd7d792-7f72-4444-8362-ce24faa563f3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1182845245', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff5fdb187c6f437294d46d193aa08d2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd7d792-7f72-4444-8362-ce24faa563f3', 'created_at': datetime.datetime(2026, 6, 1, 22, 41, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 41, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd7d792-7f72-4444-8362-ce24faa563f3/file', 'properties': {}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b185e7d4-4a6f-4f83-b712-1f077756d0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b185e7d4-4a6f-4f83-b712-1f077756d0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafc74d2-2cf8-4c43-b5e1-23cf72cd75e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:07 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Volume e6f306f8-fc2b-4e08-bb9a-7138acf1a14d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d', 'volume_size': 1, 'image_id': 'edd7d792-7f72-4444-8362-ce24faa563f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd7d792-7f72-4444-8362-ce24faa563f3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1182845245', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff5fdb187c6f437294d46d193aa08d2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd7d792-7f72-4444-8362-ce24faa563f3', 'created_at': datetime.datetime(2026, 6, 1, 22, 41, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 41, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd7d792-7f72-4444-8362-ce24faa563f3/file', 'properties': {}}, 'image_service': } Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Trying to clone e6f306f8-fc2b-4e08-bb9a-7138acf1a14d from image edd7d792-7f72-4444-8362-ce24faa563f3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/edd7d792-7f72-4444-8362-ce24faa563f3', 'metadata': {}}]). {{(pid=86910) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 00:41:07 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-21d11532-460a-4153-9fd3-75ffef8634c4" returned: 0 in 0.815s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] <== create_volume: return (2117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.123s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.459s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-669090077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611b3974-a07c-4fba-b839-161f844a877f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5fdb187c6f437294d46d193aa08d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:06Z,use_quota=True,user_id='5fc70295770d42c988f8cb827ecc5b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea34b85f-15a1-41f3-903c-9e57ffd66374),volume_type_id=ea34b85f-15a1-41f3-903c-9e57ffd66374)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Creating volume 611b3974-a07c-4fba-b839-161f844a877f {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:41:07 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-611b3974-a07c-4fba-b839-161f844a877f 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac5f2f3-c107-4a2e-8a79-c6b51af287ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d11532-460a-4153-9fd3-75ffef8634c4', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a17adf7-1a29-4404-978a-0de6fe528522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:07 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-611b3974-a07c-4fba-b839-161f844a877f 1073741824 Jun 02 00:41:07 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:07 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Volume volume-21d11532-460a-4153-9fd3-75ffef8634c4 (21d11532-460a-4153-9fd3-75ffef8634c4): created successfully Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a17adf7-1a29-4404-978a-0de6fe528522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Flow 'volume_create_manager' (21233dce-5e20-43fb-8d31-013e4a22eab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:08 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-7b54d4d2-e143-4eb4-ab55-2ce2c492476b tempest-TestInstancesWithCinderVolumes-1796681864 None] Created volume successfully. Jun 02 00:41:08 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.197s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:08 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:41:08 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] Deleted volume successfully. Jun 02 00:41:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fa7ef58d-6a54-411f-9f1d-bd106549b44e tempest-VolumesExtendTest-352541698 None] Lock "cinder-693b00d5-ce9a-425a-bd54-3ea38a92d279-delete_volume" released by "delete_volume" :: held 4.019s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:08 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-611b3974-a07c-4fba-b839-161f844a877f 1073741824" returned: 0 in 1.042s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-611b3974-a07c-4fba-b839-161f844a877f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:09 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-611b3974-a07c-4fba-b839-161f844a877f Jun 02 00:41:09 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:09 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-611b3974-a07c-4fba-b839-161f844a877f" returned: 0 in 0.739s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:09 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:41:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.293s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:09 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6e144500-b59c-485c-bbad-853b173dd677,created_at=2026-06-01T22:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1717663911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e144500-b59c-485c-bbad-853b173dd677,host='devstack@QuobyteHD#QuobyteHD',id=b89b5049-c72a-477a-a769-67d4fbae78c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89acf76b620f43c5be873337c813bd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:07Z,use_quota=True,user_id='6629f76ced474035b9f204502ae89355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40a97043-57d4-450d-b99b-3490c58c5c90),volume_type_id=40a97043-57d4-450d-b99b-3490c58c5c90)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:41:09 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Creating volume b89b5049-c72a-477a-a769-67d4fbae78c3 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:41:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:09 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:09 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:09 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:41:09 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:41:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b89b5049-c72a-477a-a769-67d4fbae78c3 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:09 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b89b5049-c72a-477a-a769-67d4fbae78c3 1073741824 Jun 02 00:41:09 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:09 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b19256-30a0-4a92-a4b1-26f6f232fbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-611b3974-a07c-4fba-b839-161f844a877f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:09 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a93910c-88c1-428e-bb85-d8e64a807104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:09 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Volume volume-611b3974-a07c-4fba-b839-161f844a877f (611b3974-a07c-4fba-b839-161f844a877f): created successfully Jun 02 00:41:09 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a93910c-88c1-428e-bb85-d8e64a807104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:09 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Flow 'volume_create_manager' (a403caee-5e45-4a02-89a4-13787b708074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:09 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-bf84ccd5-72f3-43f5-a891-2d75739bee06 tempest-TestInstancesWithCinderVolumes-1796681864 None] Created volume successfully. Jun 02 00:41:10 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b89b5049-c72a-477a-a769-67d4fbae78c3 1073741824" returned: 0 in 0.993s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b89b5049-c72a-477a-a769-67d4fbae78c3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:10 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b89b5049-c72a-477a-a769-67d4fbae78c3 Jun 02 00:41:10 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:11 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b89b5049-c72a-477a-a769-67d4fbae78c3" returned: 0 in 0.737s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:11 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:41:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ac3301-42b1-4462-a101-fe49c2f7f23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b89b5049-c72a-477a-a769-67d4fbae78c3', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34c0545-1383-483f-b0dc-e90b1f954c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:11 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Volume volume-b89b5049-c72a-477a-a769-67d4fbae78c3 (b89b5049-c72a-477a-a769-67d4fbae78c3): created successfully Jun 02 00:41:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34c0545-1383-483f-b0dc-e90b1f954c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Flow 'volume_create_manager' (4145622d-3243-44df-895a-ac2a020ac570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:11 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ca293a34-75d7-4653-bb0d-ae56e2c8f9db tempest-GroupsTest-586866301 None] Created volume successfully. Jun 02 00:41:11 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_edd7d792-7f72-4444-8362-ce24faa563f3_4vt8ajcedevstack@QuobyteHD, size 20.69 MB, duration 4.22 sec {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 00:41:11 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Image download 20.69 MB at 4.90 MB/s Jun 02 00:41:12 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ed6075-58fd-4265-b62a-e93f9bc61ba2]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd7d792-7f72-4444-8362-ce24faa563f3_4vt8ajcedevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:12 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd7d792-7f72-4444-8362-ce24faa563f3_4vt8ajcedevstack@QuobyteHD Jun 02 00:41:12 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] Acquiring lock "cinder-quobyte-b89b5049-c72a-477a-a769-67d4fbae78c3" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] Lock "cinder-quobyte-b89b5049-c72a-477a-a769-67d4fbae78c3" acquired by "delete_volume" :: waited 0.030s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:12 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b805d6-67e0-458d-8b3e-30b361cbc17a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b89b5049-c72a-477a-a769-67d4fbae78c3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:12 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b89b5049-c72a-477a-a769-67d4fbae78c3 Jun 02 00:41:12 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:12 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd7d792-7f72-4444-8362-ce24faa563f3_4vt8ajcedevstack@QuobyteHD" returned: 0 in 0.822s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:12 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Temporary image edd7d792-7f72-4444-8362-ce24faa563f3 is fetched for user 5fc70295770d42c988f8cb827ecc5b36. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 00:41:12 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[879a9011-7cc2-4515-b20a-d18b82d2ea3d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd7d792-7f72-4444-8362-ce24faa563f3_4vt8ajcedevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:13 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd7d792-7f72-4444-8362-ce24faa563f3_4vt8ajcedevstack@QuobyteHD Jun 02 00:41:13 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:13 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b89b5049-c72a-477a-a769-67d4fbae78c3" returned: 0 in 0.934s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b89b5049-c72a-477a-a769-67d4fbae78c3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:13 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b89b5049-c72a-477a-a769-67d4fbae78c3 Jun 02 00:41:13 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:13 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd7d792-7f72-4444-8362-ce24faa563f3_4vt8ajcedevstack@QuobyteHD" returned: 0 in 0.879s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1482486124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f306f8-fc2b-4e08-bb9a-7138acf1a14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5fdb187c6f437294d46d193aa08d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:07Z,use_quota=True,user_id='5fc70295770d42c988f8cb827ecc5b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cc1475c-0113-4c16-9abd-4ca967fd95a5),volume_type_id=6cc1475c-0113-4c16-9abd-4ca967fd95a5)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:41:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Creating volume e6f306f8-fc2b-4e08-bb9a-7138acf1a14d {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:41:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:41:13 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:41:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:13 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d 1073741824 Jun 02 00:41:13 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:14 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b89b5049-c72a-477a-a769-67d4fbae78c3" returned: 0 in 0.714s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] Lock "cinder-quobyte-b89b5049-c72a-477a-a769-67d4fbae78c3" released by "delete_volume" :: held 1.731s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:14 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] Created reservations ['7be8ca54-dfbc-49c7-a89d-8fb25486aa0d'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:41:14 devstack cinder-volume[86910]: WARNING cinder.quota [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1755244887 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1755244887, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:41:14 devstack cinder-volume[86910]: WARNING cinder.quota [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1755244887 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1755244887, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:41:14 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] Created reservations ['c4b17984-8e25-4b22-9ac8-83a78226ef77', '2211e1f5-b2f7-475e-a80a-93e9d27dd71a', 'a0ffeb95-8f5b-4e9c-af67-a435974868a9', '5fe72a58-8139-42f6-9669-5708f3415f45'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:41:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:14 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:14 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:14 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:41:14 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:14 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-325028d5-6b1e-48c4-90b0-ec456c03a82c tempest-GroupsTest-586866301 None] Created reservations ['134b8626-209c-4cde-9164-9eb4ed0f8c04'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:41:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-325028d5-6b1e-48c4-90b0-ec456c03a82c tempest-GroupsTest-586866301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-325028d5-6b1e-48c4-90b0-ec456c03a82c tempest-GroupsTest-586866301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:14 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-325028d5-6b1e-48c4-90b0-ec456c03a82c tempest-GroupsTest-586866301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:14 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-325028d5-6b1e-48c4-90b0-ec456c03a82c tempest-GroupsTest-586866301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-325028d5-6b1e-48c4-90b0-ec456c03a82c tempest-GroupsTest-586866301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-325028d5-6b1e-48c4-90b0-ec456c03a82c tempest-GroupsTest-586866301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:14 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:41:14 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:15 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d 1073741824" returned: 0 in 1.156s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:15 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d Jun 02 00:41:15 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:15 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.908s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:41:15 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-9cd5686e-70ef-41cb-bfa0-80828e10fb0c tempest-GroupsTest-586866301 None] Delete group completed successfully. Jun 02 00:41:15 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:41:15 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Flow 'volume_create_manager' (e57c3554-071e-4cfd-8d93-1163570a1ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e55817-1447-470e-870b-f3429f0f9940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e55817-1447-470e-870b-f3429f0f9940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-418637481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52de11b7-93fc-4208-b714-e7dfb9482166,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b47ac3406ad047c08091d321058792e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:16Z,use_quota=True,user_id='dca70bbba3bc43ec961b847735d1c026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0d6b05-de88-4ef0-80be-794aa8e5dca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0d6b05-de88-4ef0-80be-794aa8e5dca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3b58e6-2321-4658-a510-553aea4a8c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3b58e6-2321-4658-a510-553aea4a8c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52de11b7-93fc-4208-b714-e7dfb9482166', 'volume_name': 'volume-52de11b7-93fc-4208-b714-e7dfb9482166', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14241ffa-e287-43a6-9d54-798c8506a7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14241ffa-e287-43a6-9d54-798c8506a7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc88c47-edb3-494f-bbae-a37de6cc6023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:15 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Volume 52de11b7-93fc-4208-b714-e7dfb9482166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52de11b7-93fc-4208-b714-e7dfb9482166', 'volume_size': 1} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:15 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-325028d5-6b1e-48c4-90b0-ec456c03a82c tempest-GroupsTest-586866301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.964s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-325028d5-6b1e-48c4-90b0-ec456c03a82c tempest-GroupsTest-586866301 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:41:15 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-325028d5-6b1e-48c4-90b0-ec456c03a82c tempest-GroupsTest-586866301 None] Delete group completed successfully. Jun 02 00:41:15 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d" returned: 0 in 0.949s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.155s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.180s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-418637481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52de11b7-93fc-4208-b714-e7dfb9482166,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b47ac3406ad047c08091d321058792e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:16Z,use_quota=True,user_id='dca70bbba3bc43ec961b847735d1c026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Creating volume 52de11b7-93fc-4208-b714-e7dfb9482166 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:41:16 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-52de11b7-93fc-4208-b714-e7dfb9482166 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Attempting download of edd7d792-7f72-4444-8362-ce24faa563f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/edd7d792-7f72-4444-8362-ce24faa563f3', 'metadata': {}}])) to volume e6f306f8-fc2b-4e08-bb9a-7138acf1a14d. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 00:41:16 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-52de11b7-93fc-4208-b714-e7dfb9482166 1073741824 Jun 02 00:41:16 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:16 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.826s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1596b9-4bdb-429d-85ac-459f0bd9f031]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd7d792-7f72-4444-8362-ce24faa563f3__o3j1aj0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:16 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd7d792-7f72-4444-8362-ce24faa563f3__o3j1aj0 Jun 02 00:41:16 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:16 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e5d5b4ad-d624-4755-a1a9-30d329adb2b7 tempest-GroupsTest-586866301 None] Group tempest-GroupsTest-Group-1632014465: creating Jun 02 00:41:16 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e5d5b4ad-d624-4755-a1a9-30d329adb2b7 tempest-GroupsTest-586866301 None] Group tempest-GroupsTest-Group-1632014465: created successfully Jun 02 00:41:16 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e5d5b4ad-d624-4755-a1a9-30d329adb2b7 tempest-GroupsTest-586866301 None] Create group completed successfully. Jun 02 00:41:16 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-52de11b7-93fc-4208-b714-e7dfb9482166 1073741824" returned: 0 in 0.917s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:16 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd7d792-7f72-4444-8362-ce24faa563f3__o3j1aj0" returned: 0 in 0.831s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd7d792-7f72-4444-8362-ce24faa563f3__o3j1aj0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-52de11b7-93fc-4208-b714-e7dfb9482166 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:17 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-52de11b7-93fc-4208-b714-e7dfb9482166 Jun 02 00:41:17 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:17 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd7d792-7f72-4444-8362-ce24faa563f3__o3j1aj0 Jun 02 00:41:17 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:17 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-52de11b7-93fc-4208-b714-e7dfb9482166" returned: 0 in 0.615s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:17 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:41:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc88c47-edb3-494f-bbae-a37de6cc6023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52de11b7-93fc-4208-b714-e7dfb9482166', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6218dd1-786e-401f-8444-4003f259288a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:17 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Volume volume-52de11b7-93fc-4208-b714-e7dfb9482166 (52de11b7-93fc-4208-b714-e7dfb9482166): created successfully Jun 02 00:41:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6218dd1-786e-401f-8444-4003f259288a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Flow 'volume_create_manager' (e57c3554-071e-4cfd-8d93-1163570a1ed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:17 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-875f8405-dd4a-4f88-a51a-514d5dbb965e tempest-VolumesListTestJSON-2139469514 None] Created volume successfully. Jun 02 00:41:17 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd7d792-7f72-4444-8362-ce24faa563f3__o3j1aj0" returned: 1 in 0.735s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd7d792-7f72-4444-8362-ce24faa563f3__o3j1aj0' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:41:17 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4472edd-9522-4a78-aeb1-a9c38863074e]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd7d792-7f72-4444-8362-ce24faa563f3_4vt8ajcedevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:17 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd7d792-7f72-4444-8362-ce24faa563f3_4vt8ajcedevstack@QuobyteHD Jun 02 00:41:17 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Flow 'volume_create_manager' (761da5dc-53ff-464f-b6a5-bb47f106dd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d054000-af61-4942-b4fe-420f5a776e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d054000-af61-4942-b4fe-420f5a776e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-748531521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d81bf98-a20e-4da8-8dc0-4fc6596075a4,host='devstack@QuobyteHD#QuobyteHD',id=54927c9f-0406-47df-9055-92c8a813b3ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89acf76b620f43c5be873337c813bd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:18Z,use_quota=True,user_id='6629f76ced474035b9f204502ae89355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9133621-6734-49e7-af15-14c261f92d88),volume_type_id=d9133621-6734-49e7-af15-14c261f92d88)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fa46a1-ca1e-4be4-a38b-4b4ee56f28ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fa46a1-ca1e-4be4-a38b-4b4ee56f28ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96449de6-57e6-4339-a898-21e2210de5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96449de6-57e6-4339-a898-21e2210de5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54927c9f-0406-47df-9055-92c8a813b3ef', 'volume_name': 'volume-54927c9f-0406-47df-9055-92c8a813b3ef', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7806c01e-40ca-4dbc-b6ce-051e930d337a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7806c01e-40ca-4dbc-b6ce-051e930d337a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70423090-5357-494b-9ec6-f1e1cf2a181f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:18 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Volume 54927c9f-0406-47df-9055-92c8a813b3ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54927c9f-0406-47df-9055-92c8a813b3ef', 'volume_size': 1} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7d81bf98-a20e-4da8-8dc0-4fc6596075a4,created_at=2026-06-01T22:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-748531521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d81bf98-a20e-4da8-8dc0-4fc6596075a4,host='devstack@QuobyteHD#QuobyteHD',id=54927c9f-0406-47df-9055-92c8a813b3ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89acf76b620f43c5be873337c813bd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:18Z,use_quota=True,user_id='6629f76ced474035b9f204502ae89355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9133621-6734-49e7-af15-14c261f92d88),volume_type_id=d9133621-6734-49e7-af15-14c261f92d88)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Creating volume 54927c9f-0406-47df-9055-92c8a813b3ef {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:41:18 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-54927c9f-0406-47df-9055-92c8a813b3ef 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:18 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-54927c9f-0406-47df-9055-92c8a813b3ef 1073741824 Jun 02 00:41:18 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:18 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd7d792-7f72-4444-8362-ce24faa563f3_4vt8ajcedevstack@QuobyteHD" returned: 0 in 0.820s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] edd7d792-7f72-4444-8362-ce24faa563f3 was qcow2, converting to raw {{(pid=86910) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd7d792-7f72-4444-8362-ce24faa563f3_4vt8ajcedevstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:18 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd7d792-7f72-4444-8362-ce24faa563f3_4vt8ajcedevstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d Jun 02 00:41:18 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Flow 'volume_create_manager' (9abedad8-2786-4750-b891-02eeacda9dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9ac343-09f2-4a62-bf72-018d54a45a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9ac343-09f2-4a62-bf72-018d54a45a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2084013914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8628e532-cd00-4c71-93c8-483967037016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7734774e0fe46ebac5a705791d28bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:19Z,use_quota=True,user_id='4fb5a95951404d31a9f8730f67850888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221137a7-94e0-4f3d-aa21-9f5589ab81eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221137a7-94e0-4f3d-aa21-9f5589ab81eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2186e7ad-ff21-4a03-bbb8-c9bbf48da255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2186e7ad-ff21-4a03-bbb8-c9bbf48da255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8628e532-cd00-4c71-93c8-483967037016', 'volume_name': 'volume-8628e532-cd00-4c71-93c8-483967037016', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c93f2a-7899-4d57-8e02-28dc4c40042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c93f2a-7899-4d57-8e02-28dc4c40042f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5655f0e-ed55-4a55-bd47-9a0ecda2094a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:18 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Volume 8628e532-cd00-4c71-93c8-483967037016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8628e532-cd00-4c71-93c8-483967037016', 'volume_size': 1} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Flow 'volume_create_manager' (dd69b89a-850e-4b2e-a972-1b80d9662975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5099ffd9-1cf0-4b20-9581-a83f84eed005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5099ffd9-1cf0-4b20-9581-a83f84eed005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-95988328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7628d920-c764-4df1-93b8-4a724fa052c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b47ac3406ad047c08091d321058792e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:19Z,use_quota=True,user_id='dca70bbba3bc43ec961b847735d1c026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f05583-049e-4be8-b7c8-33a884635ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f05583-049e-4be8-b7c8-33a884635ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd3827e-ae4d-428d-b67e-6ba7694ff788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd3827e-ae4d-428d-b67e-6ba7694ff788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7628d920-c764-4df1-93b8-4a724fa052c9', 'volume_name': 'volume-7628d920-c764-4df1-93b8-4a724fa052c9', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8d3677-d9e0-45fa-9497-50e69b5b2c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8d3677-d9e0-45fa-9497-50e69b5b2c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1f27c7-dfa8-428f-9390-2153e55ba50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:18 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Volume 7628d920-c764-4df1-93b8-4a724fa052c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7628d920-c764-4df1-93b8-4a724fa052c9', 'volume_size': 1} Jun 02 00:41:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:19 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-54927c9f-0406-47df-9055-92c8a813b3ef 1073741824" returned: 0 in 0.839s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-54927c9f-0406-47df-9055-92c8a813b3ef {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:19 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-54927c9f-0406-47df-9055-92c8a813b3ef Jun 02 00:41:19 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:19 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-54927c9f-0406-47df-9055-92c8a813b3ef" returned: 0 in 0.629s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.125s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2084013914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8628e532-cd00-4c71-93c8-483967037016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7734774e0fe46ebac5a705791d28bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:19Z,use_quota=True,user_id='4fb5a95951404d31a9f8730f67850888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Creating volume 8628e532-cd00-4c71-93c8-483967037016 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:41:19 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8628e532-cd00-4c71-93c8-483967037016 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70423090-5357-494b-9ec6-f1e1cf2a181f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54927c9f-0406-47df-9055-92c8a813b3ef', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:19 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8628e532-cd00-4c71-93c8-483967037016 1073741824 Jun 02 00:41:19 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac86aec-9834-48a6-ab07-d9bfea47a841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:19 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Volume volume-54927c9f-0406-47df-9055-92c8a813b3ef (54927c9f-0406-47df-9055-92c8a813b3ef): created successfully Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac86aec-9834-48a6-ab07-d9bfea47a841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Flow 'volume_create_manager' (761da5dc-53ff-464f-b6a5-bb47f106dd06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:19 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-40dead63-06ab-420b-a276-8bc1f3dee17e tempest-GroupsTest-586866301 None] Created volume successfully. Jun 02 00:41:20 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd7d792-7f72-4444-8362-ce24faa563f3_4vt8ajcedevstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d" returned: 0 in 1.927s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:20 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_edd7d792-7f72-4444-8362-ce24faa563f3_4vt8ajcedevstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:41:20 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Converted 112.00 MB image at 58.08 MB/s Jun 02 00:41:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:20 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d 1G Jun 02 00:41:20 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:20 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8628e532-cd00-4c71-93c8-483967037016 1073741824" returned: 0 in 0.815s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8628e532-cd00-4c71-93c8-483967037016 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:20 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8628e532-cd00-4c71-93c8-483967037016 Jun 02 00:41:20 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:20 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:41:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Flow 'volume_create_manager' (9268eb4f-f979-4899-891c-bc8e7585cca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66c9db9-9bc7-453a-821b-d36ebc94230a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66c9db9-9bc7-453a-821b-d36ebc94230a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-851188743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d81bf98-a20e-4da8-8dc0-4fc6596075a4,host='devstack@QuobyteHD#QuobyteHD',id=70ee0d48-35b3-491d-a5b8-b6ba0e66d16b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89acf76b620f43c5be873337c813bd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:21Z,use_quota=True,user_id='6629f76ced474035b9f204502ae89355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9133621-6734-49e7-af15-14c261f92d88),volume_type_id=d9133621-6734-49e7-af15-14c261f92d88)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22742dd-e2f3-4a6f-824b-aac151a2ec9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22742dd-e2f3-4a6f-824b-aac151a2ec9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e414c18-2a52-4721-aa2f-1b0623111195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e414c18-2a52-4721-aa2f-1b0623111195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ee0d48-35b3-491d-a5b8-b6ba0e66d16b', 'volume_name': 'volume-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60170b81-db06-4114-9d80-8c2b3b0e6788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60170b81-db06-4114-9d80-8c2b3b0e6788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43682464-b6c6-4917-9eb5-b1b9368b99be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:21 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Volume 70ee0d48-35b3-491d-a5b8-b6ba0e66d16b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b', 'volume_size': 1} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:21 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d 1G" returned: 0 in 0.679s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef39691f-50a7-49ab-aee6-91f2986c2248]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:21 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d Jun 02 00:41:21 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:21 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8628e532-cd00-4c71-93c8-483967037016" returned: 0 in 0.653s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.551s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-95988328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7628d920-c764-4df1-93b8-4a724fa052c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b47ac3406ad047c08091d321058792e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:19Z,use_quota=True,user_id='dca70bbba3bc43ec961b847735d1c026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Creating volume 7628d920-c764-4df1-93b8-4a724fa052c9 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:41:21 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7628d920-c764-4df1-93b8-4a724fa052c9 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5655f0e-ed55-4a55-bd47-9a0ecda2094a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8628e532-cd00-4c71-93c8-483967037016', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:21 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7628d920-c764-4df1-93b8-4a724fa052c9 1073741824 Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36765127-73dd-45e5-980c-7d22ac8527fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:21 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:21 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Volume volume-8628e532-cd00-4c71-93c8-483967037016 (8628e532-cd00-4c71-93c8-483967037016): created successfully Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36765127-73dd-45e5-980c-7d22ac8527fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Flow 'volume_create_manager' (9abedad8-2786-4750-b891-02eeacda9dea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:21 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-2dee510c-4023-41ec-8843-13157c92674d tempest-VolumesListAdminTestJSON-1983909151 None] Created volume successfully. Jun 02 00:41:21 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d" returned: 0 in 0.703s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:22 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d Jun 02 00:41:22 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:41:22 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Flow 'volume_create_manager' (c4f02041-2496-4d95-b47a-db9dc3dcd25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e139a6-5a96-42b8-a72f-c2edeee577fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7628d920-c764-4df1-93b8-4a724fa052c9 1073741824" returned: 0 in 0.974s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e139a6-5a96-42b8-a72f-c2edeee577fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-410420483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40009581-755f-4a5d-99ec-002478f55d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7734774e0fe46ebac5a705791d28bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:22Z,use_quota=True,user_id='4fb5a95951404d31a9f8730f67850888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe29584-3470-402f-a0da-7f13bc334c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe29584-3470-402f-a0da-7f13bc334c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3fb6c4-360c-478a-82b9-9e87c2ebd018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3fb6c4-360c-478a-82b9-9e87c2ebd018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40009581-755f-4a5d-99ec-002478f55d8a', 'volume_name': 'volume-40009581-755f-4a5d-99ec-002478f55d8a', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc325cb1-6be3-42d8-9fdc-8e317ecf9d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc325cb1-6be3-42d8-9fdc-8e317ecf9d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51dec6fb-f64c-457c-ae45-7ab06a91aa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:22 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Volume 40009581-755f-4a5d-99ec-002478f55d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40009581-755f-4a5d-99ec-002478f55d8a', 'volume_size': 1} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7628d920-c764-4df1-93b8-4a724fa052c9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:22 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7628d920-c764-4df1-93b8-4a724fa052c9 Jun 02 00:41:22 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:22 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d" returned: 1 in 0.766s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Downloaded image edd7d792-7f72-4444-8362-ce24faa563f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/edd7d792-7f72-4444-8362-ce24faa563f3', 'metadata': {}}])) to volume e6f306f8-fc2b-4e08-bb9a-7138acf1a14d successfully. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Temporary image edd7d792-7f72-4444-8362-ce24faa563f3 for user 5fc70295770d42c988f8cb827ecc5b36 is deleted. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Marking volume e6f306f8-fc2b-4e08-bb9a-7138acf1a14d as bootable. {{(pid=86910) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Copying metadata from image edd7d792-7f72-4444-8362-ce24faa563f3 to e6f306f8-fc2b-4e08-bb9a-7138acf1a14d. {{(pid=86910) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Creating volume glance metadata for volume e6f306f8-fc2b-4e08-bb9a-7138acf1a14d backed by image edd7d792-7f72-4444-8362-ce24faa563f3 with: {'image_id': 'edd7d792-7f72-4444-8362-ce24faa563f3', 'image_name': 'tempest-scenario-img--1182845245', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86910) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafc74d2-2cf8-4c43-b5e1-23cf72cd75e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d', 'volume_size': 1, 'image_id': 'edd7d792-7f72-4444-8362-ce24faa563f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd7d792-7f72-4444-8362-ce24faa563f3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1182845245', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff5fdb187c6f437294d46d193aa08d2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd7d792-7f72-4444-8362-ce24faa563f3', 'created_at': datetime.datetime(2026, 6, 1, 22, 41, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 41, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd7d792-7f72-4444-8362-ce24faa563f3/file', 'properties': {}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea15b3e-37a8-43dd-8cc9-adc1eb0f8974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:22 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Volume volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d (e6f306f8-fc2b-4e08-bb9a-7138acf1a14d): created successfully Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea15b3e-37a8-43dd-8cc9-adc1eb0f8974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Flow 'volume_create_manager' (2f14304b-c89d-44db-812f-799ab779f5b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:22 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a2cf17c3-ca7a-4d6d-833e-6b66f269bc57 tempest-TestInstancesWithCinderVolumes-1796681864 None] Created volume successfully. Jun 02 00:41:23 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7628d920-c764-4df1-93b8-4a724fa052c9" returned: 0 in 0.606s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.022s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7d81bf98-a20e-4da8-8dc0-4fc6596075a4,created_at=2026-06-01T22:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-851188743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d81bf98-a20e-4da8-8dc0-4fc6596075a4,host='devstack@QuobyteHD#QuobyteHD',id=70ee0d48-35b3-491d-a5b8-b6ba0e66d16b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89acf76b620f43c5be873337c813bd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:21Z,use_quota=True,user_id='6629f76ced474035b9f204502ae89355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9133621-6734-49e7-af15-14c261f92d88),volume_type_id=d9133621-6734-49e7-af15-14c261f92d88)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Creating volume 70ee0d48-35b3-491d-a5b8-b6ba0e66d16b {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:41:23 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:23 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b 1073741824 Jun 02 00:41:23 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1f27c7-dfa8-428f-9390-2153e55ba50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7628d920-c764-4df1-93b8-4a724fa052c9', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a7731c-d1a6-4f1c-a821-98ae27ac4161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:23 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Volume volume-7628d920-c764-4df1-93b8-4a724fa052c9 (7628d920-c764-4df1-93b8-4a724fa052c9): created successfully Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a7731c-d1a6-4f1c-a821-98ae27ac4161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Flow 'volume_create_manager' (dd69b89a-850e-4b2e-a972-1b80d9662975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:23 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-63026988-c139-498f-b489-e3fe30fb6c87 tempest-VolumesListTestJSON-2139469514 None] Created volume successfully. Jun 02 00:41:23 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b 1073741824" returned: 0 in 0.878s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:23 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b Jun 02 00:41:23 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Flow 'volume_create_manager' (450e3619-fa29-440f-afcf-499c7435f5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5585cf-61f9-4e4a-8030-6ecbb0afec6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5585cf-61f9-4e4a-8030-6ecbb0afec6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1175833143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b47ac3406ad047c08091d321058792e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:24Z,use_quota=True,user_id='dca70bbba3bc43ec961b847735d1c026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231fb4d9-21c2-4ecc-8714-4b5db0ab8c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231fb4d9-21c2-4ecc-8714-4b5db0ab8c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420784eb-869c-43fe-8361-85235af67912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420784eb-869c-43fe-8361-85235af67912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df', 'volume_name': 'volume-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:24 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0563d771-e6d4-423b-ab23-7c4d20c5e2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0563d771-e6d4-423b-ab23-7c4d20c5e2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29405e51-549b-4799-8166-84cd2a93838f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:24 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Volume fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df', 'volume_size': 1} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b" returned: 0 in 0.643s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.210s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-410420483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40009581-755f-4a5d-99ec-002478f55d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7734774e0fe46ebac5a705791d28bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:22Z,use_quota=True,user_id='4fb5a95951404d31a9f8730f67850888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Creating volume 40009581-755f-4a5d-99ec-002478f55d8a {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:41:24 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-40009581-755f-4a5d-99ec-002478f55d8a 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43682464-b6c6-4917-9eb5-b1b9368b99be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88d807a-1922-41fa-b411-3ffe0cad7123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:24 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-40009581-755f-4a5d-99ec-002478f55d8a 1073741824 Jun 02 00:41:24 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:24 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Volume volume-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b (70ee0d48-35b3-491d-a5b8-b6ba0e66d16b): created successfully Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88d807a-1922-41fa-b411-3ffe0cad7123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Flow 'volume_create_manager' (9268eb4f-f979-4899-891c-bc8e7585cca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:24 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-1b4ff7ae-5fc2-4006-aab2-d253e316a793 tempest-GroupsTest-586866301 None] Created volume successfully. Jun 02 00:41:25 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-40009581-755f-4a5d-99ec-002478f55d8a 1073741824" returned: 0 in 0.891s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-40009581-755f-4a5d-99ec-002478f55d8a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:25 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-40009581-755f-4a5d-99ec-002478f55d8a Jun 02 00:41:25 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-8976e4f0-9b9c-44d1-b72e-55140e8af882 tempest-GroupsTest-586866301 None] Update group completed successfully. Jun 02 00:41:25 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:26 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-40009581-755f-4a5d-99ec-002478f55d8a" returned: 0 in 0.608s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:41:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.564s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1175833143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b47ac3406ad047c08091d321058792e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:24Z,use_quota=True,user_id='dca70bbba3bc43ec961b847735d1c026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:41:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Creating volume fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:41:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:41:26 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:41:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:26 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51dec6fb-f64c-457c-ae45-7ab06a91aa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40009581-755f-4a5d-99ec-002478f55d8a', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:26 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df 1073741824 Jun 02 00:41:26 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:26 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0218edb2-8653-40ed-b6d0-5884a3f85ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:26 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Volume volume-40009581-755f-4a5d-99ec-002478f55d8a (40009581-755f-4a5d-99ec-002478f55d8a): created successfully Jun 02 00:41:26 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0218edb2-8653-40ed-b6d0-5884a3f85ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:26 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Flow 'volume_create_manager' (c4f02041-2496-4d95-b47a-db9dc3dcd25d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:26 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-da24ee83-33b1-4080-991a-3f0b5741051b tempest-VolumesListAdminTestJSON-1983909151 None] Created volume successfully. Jun 02 00:41:26 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f968be1f-9f57-4525-bcc0-89380622a6b7 tempest-GroupsTest-586866301 None] Update group completed successfully. Jun 02 00:41:27 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df 1073741824" returned: 0 in 0.857s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:27 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df Jun 02 00:41:27 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Flow 'volume_create_manager' (cf9e56fc-77f0-443e-aa27-7506935e8d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c3a0d45-d401-4081-9950-532215c5b789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c3a0d45-d401-4081-9950-532215c5b789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-469284566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf058a67-dfa3-4f22-b997-b7dd1969df98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7734774e0fe46ebac5a705791d28bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:27Z,use_quota=True,user_id='4fb5a95951404d31a9f8730f67850888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c416550b-a4b5-4d4c-8be9-f75e395c6b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c416550b-a4b5-4d4c-8be9-f75e395c6b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635f6811-afbf-40ad-9aae-e68dee9d5506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635f6811-afbf-40ad-9aae-e68dee9d5506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf058a67-dfa3-4f22-b997-b7dd1969df98', 'volume_name': 'volume-cf058a67-dfa3-4f22-b997-b7dd1969df98', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7f7436-e38b-4028-a5d1-b963d97a98d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7f7436-e38b-4028-a5d1-b963d97a98d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d6b600-c608-400b-a306-031d9e91cc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:27 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Volume cf058a67-dfa3-4f22-b997-b7dd1969df98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf058a67-dfa3-4f22-b997-b7dd1969df98', 'volume_size': 1} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:27 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df" returned: 0 in 0.612s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.464s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-469284566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf058a67-dfa3-4f22-b997-b7dd1969df98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7734774e0fe46ebac5a705791d28bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:27Z,use_quota=True,user_id='4fb5a95951404d31a9f8730f67850888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Creating volume cf058a67-dfa3-4f22-b997-b7dd1969df98 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:41:27 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cf058a67-dfa3-4f22-b997-b7dd1969df98 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29405e51-549b-4799-8166-84cd2a93838f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:27 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cf058a67-dfa3-4f22-b997-b7dd1969df98 1073741824 Jun 02 00:41:27 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da0686e-b2fd-40ad-8dd7-818f1970730e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:27 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Volume volume-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df (fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df): created successfully Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da0686e-b2fd-40ad-8dd7-818f1970730e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Flow 'volume_create_manager' (450e3619-fa29-440f-afcf-499c7435f5b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:27 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-fefcdd15-bddd-4e3e-a10e-1b96df054170 tempest-VolumesListTestJSON-2139469514 None] Created volume successfully. Jun 02 00:41:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Acquiring lock "cinder-quobyte-54927c9f-0406-47df-9055-92c8a813b3ef" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Lock "cinder-quobyte-54927c9f-0406-47df-9055-92c8a813b3ef" acquired by "delete_volume" :: waited 0.023s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:28 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2ce5ed-e59f-4200-83c5-a54e7f1add00]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-54927c9f-0406-47df-9055-92c8a813b3ef {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:28 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-54927c9f-0406-47df-9055-92c8a813b3ef Jun 02 00:41:28 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:28 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cf058a67-dfa3-4f22-b997-b7dd1969df98 1073741824" returned: 0 in 0.836s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cf058a67-dfa3-4f22-b997-b7dd1969df98 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:28 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cf058a67-dfa3-4f22-b997-b7dd1969df98 Jun 02 00:41:28 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:29 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-54927c9f-0406-47df-9055-92c8a813b3ef" returned: 0 in 0.747s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-54927c9f-0406-47df-9055-92c8a813b3ef {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:29 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-54927c9f-0406-47df-9055-92c8a813b3ef Jun 02 00:41:29 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:29 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cf058a67-dfa3-4f22-b997-b7dd1969df98" returned: 0 in 0.646s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:29 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:41:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d6b600-c608-400b-a306-031d9e91cc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf058a67-dfa3-4f22-b997-b7dd1969df98', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542c0336-6746-4f3f-ab62-15663bc6c4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:29 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Volume volume-cf058a67-dfa3-4f22-b997-b7dd1969df98 (cf058a67-dfa3-4f22-b997-b7dd1969df98): created successfully Jun 02 00:41:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542c0336-6746-4f3f-ab62-15663bc6c4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Flow 'volume_create_manager' (cf9e56fc-77f0-443e-aa27-7506935e8d00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:29 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-28ef65ac-f2cc-4709-9169-fc82475cae6f tempest-VolumesListAdminTestJSON-1983909151 None] Created volume successfully. Jun 02 00:41:29 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-54927c9f-0406-47df-9055-92c8a813b3ef" returned: 0 in 0.749s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Lock "cinder-quobyte-54927c9f-0406-47df-9055-92c8a813b3ef" released by "delete_volume" :: held 1.544s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Acquiring lock "cinder-quobyte-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Lock "cinder-quobyte-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b" acquired by "delete_volume" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:29 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[598fc063-b068-4bb3-a149-5594fcf64ecb]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:30 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b Jun 02 00:41:30 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:30 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b" returned: 0 in 1.075s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:31 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b Jun 02 00:41:31 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=173,cinder:SELECT=132,cinder:DELETE=18,cinder:INSERT=50 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-0daf7358-8950-4873-a544-cebdfe8c3c7d req-d84d542e-0532-4125-8415-385b96d78bf5 tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-0daf7358-8950-4873-a544-cebdfe8c3c7d req-d84d542e-0532-4125-8415-385b96d78bf5 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f611bcb5-90cf-4a6f-9363-ecadfab95d5a]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-0daf7358-8950-4873-a544-cebdfe8c3c7d req-d84d542e-0532-4125-8415-385b96d78bf5 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Flow 'volume_create_manager' (52754cf6-26c8-45bd-8163-fc94e067ea38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d639b6-fdd8-4417-a977-f1d8226d5228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d639b6-fdd8-4417-a977-f1d8226d5228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1f0e89-787f-400a-b4ae-7b88a606a197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68d33f10724408b9af61e38467d5204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:31Z,use_quota=True,user_id='4720cf5e00094b6fbcbec4dc0c33afee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e965c96a-5be9-48d2-a291-79668ba83805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e965c96a-5be9-48d2-a291-79668ba83805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5047d009-6a54-4dea-90ae-becd0f9be826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5047d009-6a54-4dea-90ae-becd0f9be826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f1f0e89-787f-400a-b4ae-7b88a606a197', 'volume_name': 'volume-3f1f0e89-787f-400a-b4ae-7b88a606a197', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2fba82-09f5-4131-80d7-ddc0834743df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2fba82-09f5-4131-80d7-ddc0834743df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e4571a-a1c9-4d02-bf02-1dfda9bfda10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:31 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Volume 3f1f0e89-787f-400a-b4ae-7b88a606a197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f1f0e89-787f-400a-b4ae-7b88a606a197', 'volume_size': 1} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:31 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d Jun 02 00:41:31 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:31 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b" returned: 0 in 0.906s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Lock "cinder-quobyte-70ee0d48-35b3-491d-a5b8-b6ba0e66d16b" released by "delete_volume" :: held 2.042s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] Acquiring lock "cinder-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] Lock "cinder-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:32 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Created reservations ['f1310f3f-5a14-46fd-92a6-e9078a5b6e23'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:41:32 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] Acquiring lock "cinder-quobyte-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:32 devstack cinder-volume[86910]: WARNING cinder.quota [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-406173270 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-406173270, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:41:32 devstack cinder-volume[86910]: WARNING cinder.quota [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-406173270 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-406173270, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:41:32 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] Lock "cinder-quobyte-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df" acquired by "delete_volume" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:32 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[44744616-d4b9-4160-b79e-d0b7c27e622d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:32 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Created reservations ['96d6b848-49fc-4cac-823c-44f6f830cfff', 'e9330175-6ab3-4648-8f81-13f4a4752359', '6f5a273a-b85d-4de1-8a3d-935052361f1d', '07c0a191-4dc2-4f35-a0dc-71a333c03008'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:41:32 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Created reservations ['413be710-bd85-4e95-9451-10504a21a448', 'ed6231eb-c657-45a3-b3af-30bd8597cb34', '52811912-a19a-49d1-a0f8-14ab842f28a3', '26e2ec9a-4687-43ba-8b69-6c25b3a8d663'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:41:32 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df Jun 02 00:41:32 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:32 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-0daf7358-8950-4873-a544-cebdfe8c3c7d req-d84d542e-0532-4125-8415-385b96d78bf5 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d" returned: 0 in 0.972s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-0daf7358-8950-4873-a544-cebdfe8c3c7d req-d84d542e-0532-4125-8415-385b96d78bf5 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:32 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:32 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:32 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:41:32 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:32 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d Jun 02 00:41:32 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:32 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df" returned: 0 in 0.867s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:32 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df Jun 02 00:41:32 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:33 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.640s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:41:33 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-0ce851d3-8df7-4170-acfc-11e8998eeb70 tempest-GroupsTest-586866301 None] Delete group completed successfully. Jun 02 00:41:33 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-0daf7358-8950-4873-a544-cebdfe8c3c7d req-d84d542e-0532-4125-8415-385b96d78bf5 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d" returned: 1 in 0.829s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-0daf7358-8950-4873-a544-cebdfe8c3c7d req-d84d542e-0532-4125-8415-385b96d78bf5 tempest-TestInstancesWithCinderVolumes-1796681864 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-0daf7358-8950-4873-a544-cebdfe8c3c7d req-d84d542e-0532-4125-8415-385b96d78bf5 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.877s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.673s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1f0e89-787f-400a-b4ae-7b88a606a197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68d33f10724408b9af61e38467d5204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:31Z,use_quota=True,user_id='4720cf5e00094b6fbcbec4dc0c33afee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Creating volume 3f1f0e89-787f-400a-b4ae-7b88a606a197 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:41:33 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3f1f0e89-787f-400a-b4ae-7b88a606a197 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:33 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3f1f0e89-787f-400a-b4ae-7b88a606a197 1073741824 Jun 02 00:41:33 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-0daf7358-8950-4873-a544-cebdfe8c3c7d req-d84d542e-0532-4125-8415-385b96d78bf5 tempest-TestInstancesWithCinderVolumes-1796681864 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cdfdb90b-502d-43f4-a40a-d2cbc518bde6', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:41:33 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-0daf7358-8950-4873-a544-cebdfe8c3c7d req-d84d542e-0532-4125-8415-385b96d78bf5 tempest-TestInstancesWithCinderVolumes-1796681864 None] attachment_update completed successfully. Jun 02 00:41:33 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df" returned: 0 in 0.740s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] Lock "cinder-quobyte-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df" released by "delete_volume" :: held 1.659s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] Created reservations ['71b9cb32-f020-4611-bfc1-abc9d6955479', 'e53f325a-f47b-4734-b390-83d36050728e', '86e7bbf5-a27f-4891-af2e-79358f9e31b2', '0fa514ef-07ac-45b9-b759-939fe489339d'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:33 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:41:33 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:34 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3f1f0e89-787f-400a-b4ae-7b88a606a197 1073741824" returned: 0 in 1.055s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3f1f0e89-787f-400a-b4ae-7b88a606a197 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] Acquiring lock "cinder-7628d920-c764-4df1-93b8-4a724fa052c9-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:34 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3f1f0e89-787f-400a-b4ae-7b88a606a197 Jun 02 00:41:34 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] Lock "cinder-7628d920-c764-4df1-93b8-4a724fa052c9-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] Acquiring lock "cinder-quobyte-7628d920-c764-4df1-93b8-4a724fa052c9" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] Lock "cinder-quobyte-7628d920-c764-4df1-93b8-4a724fa052c9" acquired by "delete_volume" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:34 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[00102a5d-4bd3-4e40-9635-4cdb140032a4]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7628d920-c764-4df1-93b8-4a724fa052c9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:34 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7628d920-c764-4df1-93b8-4a724fa052c9 Jun 02 00:41:34 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:34 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.885s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:34 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:41:34 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] Deleted volume successfully. Jun 02 00:41:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-75c904aa-22b9-4816-9195-db281fa6c57b tempest-VolumesListTestJSON-2139469514 None] Lock "cinder-fbf30f19-d4aa-4bd3-9afb-7fbddd45f1df-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:35 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3f1f0e89-787f-400a-b4ae-7b88a606a197" returned: 0 in 0.766s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:41:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e4571a-a1c9-4d02-bf02-1dfda9bfda10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f1f0e89-787f-400a-b4ae-7b88a606a197', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6ca9ad-f45d-4c82-84ac-d687065e432b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:35 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Volume volume-3f1f0e89-787f-400a-b4ae-7b88a606a197 (3f1f0e89-787f-400a-b4ae-7b88a606a197): created successfully Jun 02 00:41:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6ca9ad-f45d-4c82-84ac-d687065e432b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Flow 'volume_create_manager' (52754cf6-26c8-45bd-8163-fc94e067ea38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:35 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-27d3bead-1ae3-4e93-8316-dad2d2469b53 tempest-VolumesListAdminTestJSON-1416145170 None] Created volume successfully. Jun 02 00:41:35 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7628d920-c764-4df1-93b8-4a724fa052c9" returned: 0 in 0.912s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7628d920-c764-4df1-93b8-4a724fa052c9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:35 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7628d920-c764-4df1-93b8-4a724fa052c9 Jun 02 00:41:35 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] Acquiring lock "cinder-3f1f0e89-787f-400a-b4ae-7b88a606a197-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] Lock "cinder-3f1f0e89-787f-400a-b4ae-7b88a606a197-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] Acquiring lock "cinder-quobyte-3f1f0e89-787f-400a-b4ae-7b88a606a197" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] Lock "cinder-quobyte-3f1f0e89-787f-400a-b4ae-7b88a606a197" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ae29d9-9cd2-4482-9a7f-e258c31860cb]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3f1f0e89-787f-400a-b4ae-7b88a606a197 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] Acquiring lock "cinder-cf058a67-dfa3-4f22-b997-b7dd1969df98-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] Lock "cinder-cf058a67-dfa3-4f22-b997-b7dd1969df98-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] Acquiring lock "cinder-quobyte-cf058a67-dfa3-4f22-b997-b7dd1969df98" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:36 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3f1f0e89-787f-400a-b4ae-7b88a606a197 Jun 02 00:41:36 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] Lock "cinder-quobyte-cf058a67-dfa3-4f22-b997-b7dd1969df98" acquired by "delete_volume" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19844ad-2f50-41db-bf67-2cacb543fb54]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cf058a67-dfa3-4f22-b997-b7dd1969df98 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:36 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7628d920-c764-4df1-93b8-4a724fa052c9" returned: 0 in 0.927s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:36 devstack sudo[97416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cf058a67-dfa3-4f22-b997-b7dd1969df98 Jun 02 00:41:36 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] Lock "cinder-quobyte-7628d920-c764-4df1-93b8-4a724fa052c9" released by "delete_volume" :: held 1.888s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] Created reservations ['0e0de38e-9097-4ce4-a06e-4f2f9b6fa383', 'ac460afa-738b-414d-859d-66c92ad70d55', '50e56a08-746e-4453-9e5d-f714fae3e034', '80cd5017-3b59-4913-8126-0fcf415ebdd2'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:36 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:41:36 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] Acquiring lock "cinder-52de11b7-93fc-4208-b714-e7dfb9482166-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] Lock "cinder-52de11b7-93fc-4208-b714-e7dfb9482166-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] Acquiring lock "cinder-quobyte-52de11b7-93fc-4208-b714-e7dfb9482166" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] Lock "cinder-quobyte-52de11b7-93fc-4208-b714-e7dfb9482166" acquired by "delete_volume" :: waited 0.029s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c399e12-30b6-4a0e-b772-5ad8376da2cc]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-52de11b7-93fc-4208-b714-e7dfb9482166 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:37 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-52de11b7-93fc-4208-b714-e7dfb9482166 Jun 02 00:41:37 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:37 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3f1f0e89-787f-400a-b4ae-7b88a606a197" returned: 0 in 1.137s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3f1f0e89-787f-400a-b4ae-7b88a606a197 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:37 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3f1f0e89-787f-400a-b4ae-7b88a606a197 Jun 02 00:41:37 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:37 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cf058a67-dfa3-4f22-b997-b7dd1969df98" returned: 0 in 0.993s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cf058a67-dfa3-4f22-b997-b7dd1969df98 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:37 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cf058a67-dfa3-4f22-b997-b7dd1969df98 Jun 02 00:41:37 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:37 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.168s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:37 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:41:37 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] Deleted volume successfully. Jun 02 00:41:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ed1f48e5-d074-4560-adaa-ffdac9e0d99b tempest-VolumesListTestJSON-2139469514 None] Lock "cinder-7628d920-c764-4df1-93b8-4a724fa052c9-delete_volume" released by "delete_volume" :: held 3.402s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:37 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-52de11b7-93fc-4208-b714-e7dfb9482166" returned: 0 in 0.979s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-52de11b7-93fc-4208-b714-e7dfb9482166 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:37 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-52de11b7-93fc-4208-b714-e7dfb9482166 Jun 02 00:41:37 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:38 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-cf058a67-dfa3-4f22-b997-b7dd1969df98" returned: 0 in 0.926s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:38 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] Lock "cinder-quobyte-cf058a67-dfa3-4f22-b997-b7dd1969df98" released by "delete_volume" :: held 1.984s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=155,cinder:UPDATE=172,cinder:INSERT=38,cinder:DELETE=8 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3f1f0e89-787f-400a-b4ae-7b88a606a197" returned: 0 in 1.055s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] Lock "cinder-quobyte-3f1f0e89-787f-400a-b4ae-7b88a606a197" released by "delete_volume" :: held 2.265s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] Created reservations ['cfd8c6a8-70d9-4ab5-a264-bc0685035a8b', 'dc97b02b-2841-4414-b53d-469cbdc6917f', '0ca0264f-4190-4698-9e3b-4e3ecceb09ab', 'e1ce315f-789d-4301-890f-83d188a5af79'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] Created reservations ['da19d9f6-a5ae-493e-a4c1-274a61bede83', '0ffcdbaa-c8d1-470e-88f2-4bf2d4725c15', 'db6b7072-b332-4bd9-b857-0afd33410209', 'f11786f5-7599-4269-935a-62ab8be1a7dc'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:38 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:41:38 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:38 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:41:38 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:38 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-52de11b7-93fc-4208-b714-e7dfb9482166" returned: 0 in 0.839s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] Lock "cinder-quobyte-52de11b7-93fc-4208-b714-e7dfb9482166" released by "delete_volume" :: held 1.894s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:38 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] Created reservations ['19218457-1068-483e-bd7b-c7a6737f39df', '398fda33-941d-4817-acc9-0b96cdb7e13c', '48ef669b-876d-4c65-9f13-efe8ff5e7233', '78c56633-608f-4d6e-b18b-984e360e6af5'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:41:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:39 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:39 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] Acquiring lock "cinder-40009581-755f-4a5d-99ec-002478f55d8a-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:39 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:41:39 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] Lock "cinder-40009581-755f-4a5d-99ec-002478f55d8a-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] Acquiring lock "cinder-quobyte-40009581-755f-4a5d-99ec-002478f55d8a" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:39 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.175s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:39 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:41:39 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] Deleted volume successfully. Jun 02 00:41:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] Lock "cinder-quobyte-40009581-755f-4a5d-99ec-002478f55d8a" acquired by "delete_volume" :: waited 0.063s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-35cab0f0-7990-4f03-8866-9b2bcf7b9c3b tempest-VolumesListAdminTestJSON-1983909151 None] Lock "cinder-cf058a67-dfa3-4f22-b997-b7dd1969df98-delete_volume" released by "delete_volume" :: held 3.555s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:39 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[437c3f74-bc14-4e3a-8b70-4783d6f0a97a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-40009581-755f-4a5d-99ec-002478f55d8a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:39 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-40009581-755f-4a5d-99ec-002478f55d8a Jun 02 00:41:39 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:40 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.610s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:40 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:41:40 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] Deleted volume successfully. Jun 02 00:41:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f79548b4-a22c-4e44-af30-4554580db99c tempest-VolumesListAdminTestJSON-1416145170 None] Lock "cinder-3f1f0e89-787f-400a-b4ae-7b88a606a197-delete_volume" released by "delete_volume" :: held 4.197s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:40 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.159s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:40 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:41:40 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] Deleted volume successfully. Jun 02 00:41:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b03d49c9-adc9-4ce8-8fdc-30e8d6cb9179 tempest-VolumesListTestJSON-2139469514 None] Lock "cinder-52de11b7-93fc-4208-b714-e7dfb9482166-delete_volume" released by "delete_volume" :: held 3.657s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:40 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-857e7bb4-58bc-4885-82d7-d5730e8d4c42 tempest-GroupsV320Test-1125075318 None] Group tempest-GroupsV320Test-Group-489375980: creating Jun 02 00:41:40 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-857e7bb4-58bc-4885-82d7-d5730e8d4c42 tempest-GroupsV320Test-1125075318 None] Group tempest-GroupsV320Test-Group-489375980: created successfully Jun 02 00:41:40 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-857e7bb4-58bc-4885-82d7-d5730e8d4c42 tempest-GroupsV320Test-1125075318 None] Create group completed successfully. Jun 02 00:41:40 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-40009581-755f-4a5d-99ec-002478f55d8a" returned: 0 in 1.259s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-40009581-755f-4a5d-99ec-002478f55d8a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:41 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-40009581-755f-4a5d-99ec-002478f55d8a Jun 02 00:41:41 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:41 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-40009581-755f-4a5d-99ec-002478f55d8a" returned: 0 in 0.932s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] Lock "cinder-quobyte-40009581-755f-4a5d-99ec-002478f55d8a" released by "delete_volume" :: held 2.313s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:42 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] Created reservations ['a542f6d4-1282-47a1-847b-dae4e3aa8bca', '54e1ccc5-74ef-4c39-808a-4fbc06629a2b', 'e4d22078-7190-4a98-b003-f4714b894e14', 'da5fb568-aaed-4167-a5ad-b0793d1d80e1'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:41:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:42 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:42 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:42 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:41:42 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:42 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-e854ac61-eba8-4154-8bf0-ab0f04a9cd34 tempest-GroupsV320Test-1125075318 None] Created reservations ['f3fbc4bf-f306-493d-8df0-8b1641585373'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:41:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e854ac61-eba8-4154-8bf0-ab0f04a9cd34 tempest-GroupsV320Test-1125075318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e854ac61-eba8-4154-8bf0-ab0f04a9cd34 tempest-GroupsV320Test-1125075318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:42 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e854ac61-eba8-4154-8bf0-ab0f04a9cd34 tempest-GroupsV320Test-1125075318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:42 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e854ac61-eba8-4154-8bf0-ab0f04a9cd34 tempest-GroupsV320Test-1125075318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e854ac61-eba8-4154-8bf0-ab0f04a9cd34 tempest-GroupsV320Test-1125075318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e854ac61-eba8-4154-8bf0-ab0f04a9cd34 tempest-GroupsV320Test-1125075318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:43 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:41:43 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] Acquiring lock "cinder-8628e532-cd00-4c71-93c8-483967037016-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] Lock "cinder-8628e532-cd00-4c71-93c8-483967037016-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] Acquiring lock "cinder-quobyte-8628e532-cd00-4c71-93c8-483967037016" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:41:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] Lock "cinder-quobyte-8628e532-cd00-4c71-93c8-483967037016" acquired by "delete_volume" :: waited 0.040s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:41:43 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f187c1a-4f2c-470c-adab-f0d729974793]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8628e532-cd00-4c71-93c8-483967037016 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:43 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8628e532-cd00-4c71-93c8-483967037016 Jun 02 00:41:43 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:43 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.448s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:43 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:41:43 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] Deleted volume successfully. Jun 02 00:41:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bc76a8a4-2565-463f-b515-8523e97b27ae tempest-VolumesListAdminTestJSON-1983909151 None] Lock "cinder-40009581-755f-4a5d-99ec-002478f55d8a-delete_volume" released by "delete_volume" :: held 4.218s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Flow 'volume_create_manager' (756089f9-5625-40a9-9d77-fad8d2bff195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4dd551-196b-459f-9283-b106a2c0fb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4dd551-196b-459f-9283-b106a2c0fb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-854915105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24814925-f533-4207-8ce1-fc1fbb6b99cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e6f31ab3a74d418599d3c311611963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:45Z,use_quota=True,user_id='2c414813a0164f5a9447bb66a61a77cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:44 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e842384a-7203-47fd-8abf-5edf39b19908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e842384a-7203-47fd-8abf-5edf39b19908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98383f38-3871-4176-b119-f26fd9081661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98383f38-3871-4176-b119-f26fd9081661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24814925-f533-4207-8ce1-fc1fbb6b99cc', 'volume_name': 'volume-24814925-f533-4207-8ce1-fc1fbb6b99cc', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326a8732-fd31-4818-a98e-32edf05e7bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326a8732-fd31-4818-a98e-32edf05e7bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37dd9cf-66d3-4109-a401-d81f4f50642f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:44 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Volume 24814925-f533-4207-8ce1-fc1fbb6b99cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24814925-f533-4207-8ce1-fc1fbb6b99cc', 'volume_size': 1} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-854915105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24814925-f533-4207-8ce1-fc1fbb6b99cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e6f31ab3a74d418599d3c311611963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:45Z,use_quota=True,user_id='2c414813a0164f5a9447bb66a61a77cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Creating volume 24814925-f533-4207-8ce1-fc1fbb6b99cc {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:41:44 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e854ac61-eba8-4154-8bf0-ab0f04a9cd34 tempest-GroupsV320Test-1125075318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.827s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-e854ac61-eba8-4154-8bf0-ab0f04a9cd34 tempest-GroupsV320Test-1125075318 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:41:44 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e854ac61-eba8-4154-8bf0-ab0f04a9cd34 tempest-GroupsV320Test-1125075318 None] Delete group completed successfully. Jun 02 00:41:44 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8628e532-cd00-4c71-93c8-483967037016" returned: 0 in 1.506s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8628e532-cd00-4c71-93c8-483967037016 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:44 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc 1073741824 Jun 02 00:41:44 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:44 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8628e532-cd00-4c71-93c8-483967037016 Jun 02 00:41:44 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:46 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8628e532-cd00-4c71-93c8-483967037016" returned: 0 in 1.202s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] Lock "cinder-quobyte-8628e532-cd00-4c71-93c8-483967037016" released by "delete_volume" :: held 2.800s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:46 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] Created reservations ['1804fbbb-12e0-4bd1-9b81-732b68fc602a', 'c6d2a733-2dd4-4db0-b329-b0f8ce2df7c1', '590ef501-f875-414c-8df3-36b4a43e3717', 'c2c06a2c-3cee-4a40-96e4-eae7cfcfb279'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:41:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:46 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc 1073741824" returned: 0 in 1.621s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:46 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:41:46 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:46 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc Jun 02 00:41:46 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:47 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.138s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:47 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:41:47 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] Deleted volume successfully. Jun 02 00:41:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2fa073a5-523d-4dfa-a900-8dbff76aef11 tempest-VolumesListAdminTestJSON-1983909151 None] Lock "cinder-8628e532-cd00-4c71-93c8-483967037016-delete_volume" released by "delete_volume" :: held 4.408s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:41:47 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc" returned: 0 in 1.319s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] <== create_volume: return (3024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:41:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.027s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37dd9cf-66d3-4109-a401-d81f4f50642f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24814925-f533-4207-8ce1-fc1fbb6b99cc', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c262d2-f9b3-4537-b735-93b2b0661dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:47 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Volume volume-24814925-f533-4207-8ce1-fc1fbb6b99cc (24814925-f533-4207-8ce1-fc1fbb6b99cc): created successfully Jun 02 00:41:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c262d2-f9b3-4537-b735-93b2b0661dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Flow 'volume_create_manager' (756089f9-5625-40a9-9d77-fad8d2bff195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:47 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-52c7d11d-83eb-4394-9dce-0b79b16c85d8 tempest-VolumesSnapshotListTestJSON-1963164374 None] Created volume successfully. Jun 02 00:41:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] Creating offline snapshot e1694607-522c-471d-ac37-9bdfa9775c60 of volume 24814925-f533-4207-8ce1-fc1fbb6b99cc {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:41:49 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bee857-0db8-4198-8dc5-4eff3e85e00e]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:49 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc Jun 02 00:41:49 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:51 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc" returned: 0 in 1.284s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:51 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 1G Jun 02 00:41:51 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:52 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 1G" returned: 0 in 1.421s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24814925-f533-4207-8ce1-fc1fbb6b99cc -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:52 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24814925-f533-4207-8ce1-fc1fbb6b99cc -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 Jun 02 00:41:52 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:53 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24814925-f533-4207-8ce1-fc1fbb6b99cc -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60" returned: 0 in 0.939s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:53 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 is being set with open permissions: ugo+rw Jun 02 00:41:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:53 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 Jun 02 00:41:53 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:53 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:41:53 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Flow 'volume_create_manager' (8da6f4a8-7206-4a52-91fd-fe8fa92ab2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:53 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67bf3763-bf84-4356-a5d9-ec0c068161b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67bf3763-bf84-4356-a5d9-ec0c068161b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1373814061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec82deb-9558-42fc-a77f-b453d328eb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c8fe36233a46cfb6986177a23c651e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:54Z,use_quota=True,user_id='eead9a5b82fe4c7ca967d7e709221bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8121c964-9cd5-420a-ae46-5f49c57ddf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8121c964-9cd5-420a-ae46-5f49c57ddf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc49793b-e880-4be4-8b55-a4e735b244cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc49793b-e880-4be4-8b55-a4e735b244cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ec82deb-9558-42fc-a77f-b453d328eb0c', 'volume_name': 'volume-7ec82deb-9558-42fc-a77f-b453d328eb0c', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ba10ae-b77d-4d59-8168-c28f11b4119c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ba10ae-b77d-4d59-8168-c28f11b4119c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127e2f02-5800-4adb-976c-5c73e222f661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:54 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Volume 7ec82deb-9558-42fc-a77f-b453d328eb0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ec82deb-9558-42fc-a77f-b453d328eb0c', 'volume_size': 1} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:54 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60" returned: 0 in 0.851s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:54 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.info Jun 02 00:41:54 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Flow 'volume_create_manager' (ad910874-3c0b-4e19-aaaa-a07a63eaa0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506ec171-445f-4bf1-9143-8ea5b7f6aeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506ec171-445f-4bf1-9143-8ea5b7f6aeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1530911533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2a273e-58c9-43ca-9c16-8c08f63e6b26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fefb2b4c5a7b474a9ab5dde875539311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:55Z,use_quota=True,user_id='f6b029beabf8494e8159a27ceb08f9d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1a1bb7-55c6-4369-99cb-866cd01e451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1a1bb7-55c6-4369-99cb-866cd01e451c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5fa473d-395f-4471-8feb-3184f0726102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.image.glance [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Creating Keystone auth plugin from conf {{(pid=86910) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5fa473d-395f-4471-8feb-3184f0726102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9d2a273e-58c9-43ca-9c16-8c08f63e6b26', 'volume_name': 'volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26', 'volume_size': 1, 'image_id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '213591b260fd4db58e9aae1daeaec391', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'created_at': datetime.datetime(2026, 6, 1, 22, 25, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 25, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b93abc4-d162-4478-b919-a527963e0e4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4048ce0-a798-4139-ad36-76e3ae16b32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4048ce0-a798-4139-ad36-76e3ae16b32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d292cda-6b1a-4555-8721-6207f93befa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:54 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Volume 9d2a273e-58c9-43ca-9c16-8c08f63e6b26: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26', 'volume_size': 1, 'image_id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '213591b260fd4db58e9aae1daeaec391', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'created_at': datetime.datetime(2026, 6, 1, 22, 25, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 25, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b93abc4-d162-4478-b919-a527963e0e4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 02 00:41:54 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Trying to clone 9d2a273e-58c9-43ca-9c16-8c08f63e6b26 from image 1b93abc4-d162-4478-b919-a527963e0e4e at location (None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}]). {{(pid=86910) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 00:41:55 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.info" returned: 0 in 0.750s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:55 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.info is being set with open permissions: ugo+rw Jun 02 00:41:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:55 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.info Jun 02 00:41:55 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:55 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_hwlqv9nndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 00:41:55 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Image download 20.69 MB at 20.69 MB/s Jun 02 00:41:55 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbb9624-bcaa-471f-9de0-940910a2f189]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_hwlqv9nndevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:55 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_hwlqv9nndevstack@QuobyteHD Jun 02 00:41:55 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:55 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.info" returned: 0 in 0.663s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.041s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.644s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1373814061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec82deb-9558-42fc-a77f-b453d328eb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c8fe36233a46cfb6986177a23c651e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:54Z,use_quota=True,user_id='eead9a5b82fe4c7ca967d7e709221bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:41:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Creating volume 7ec82deb-9558-42fc-a77f-b453d328eb0c {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:41:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:41:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:41:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:41:55 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:41:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:55 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c 1073741824 Jun 02 00:41:55 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:55 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-4499a2c7-51b0-4e51-be05-b8b1e61c9097 tempest-VolumesSnapshotListTestJSON-1963164374 None] Create snapshot completed successfully Jun 02 00:41:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d5145bb2-15bd-4733-85fb-32a9c05d5eea tempest-VolumesSnapshotListTestJSON-1963164374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:56 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_hwlqv9nndevstack@QuobyteHD" returned: 0 in 0.889s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:56 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Temporary image 1b93abc4-d162-4478-b919-a527963e0e4e is fetched for user f6b029beabf8494e8159a27ceb08f9d9. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 00:41:56 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae1a004-ec5b-4ce5-823d-00618509d64f]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_hwlqv9nndevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:56 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_hwlqv9nndevstack@QuobyteHD Jun 02 00:41:56 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:56 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c 1073741824" returned: 0 in 1.050s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:56 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c Jun 02 00:41:56 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:57 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_hwlqv9nndevstack@QuobyteHD" returned: 0 in 0.722s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:57 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c" returned: 0 in 0.632s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:41:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:41:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d5145bb2-15bd-4733-85fb-32a9c05d5eea tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.272s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:41:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127e2f02-5800-4adb-976c-5c73e222f661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec82deb-9558-42fc-a77f-b453d328eb0c', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aeff026-861a-4748-b79e-6805a9eabdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:41:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-d5145bb2-15bd-4733-85fb-32a9c05d5eea tempest-VolumesSnapshotListTestJSON-1963164374 None] Creating offline snapshot 83741b6a-944e-4f7f-b236-db004a04ab8a of volume 24814925-f533-4207-8ce1-fc1fbb6b99cc {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:41:57 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Volume volume-7ec82deb-9558-42fc-a77f-b453d328eb0c (7ec82deb-9558-42fc-a77f-b453d328eb0c): created successfully Jun 02 00:41:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aeff026-861a-4748-b79e-6805a9eabdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:41:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Flow 'volume_create_manager' (8da6f4a8-7206-4a52-91fd-fe8fa92ab2fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:41:57 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b927d351-9663-4cc4-b2c8-8c2513c04e8a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:41:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d5145bb2-15bd-4733-85fb-32a9c05d5eea tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:57 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-14bca187-6129-44e8-8915-dfc744bbb260 tempest-SnapshotsActionsTest-1985707000 None] Created volume successfully. Jun 02 00:41:57 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 Jun 02 00:41:57 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:58 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:41:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d5145bb2-15bd-4733-85fb-32a9c05d5eea tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60" returned: 0 in 0.756s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-d5145bb2-15bd-4733-85fb-32a9c05d5eea tempest-VolumesSnapshotListTestJSON-1963164374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24814925-f533-4207-8ce1-fc1fbb6b99cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:41:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d5145bb2-15bd-4733-85fb-32a9c05d5eea tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:58 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a 1G Jun 02 00:41:58 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:59 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d5145bb2-15bd-4733-85fb-32a9c05d5eea tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a 1G" returned: 0 in 0.745s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d5145bb2-15bd-4733-85fb-32a9c05d5eea tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:59 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a Jun 02 00:41:59 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:41:59 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jun 02 00:41:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d5145bb2-15bd-4733-85fb-32a9c05d5eea tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a" returned: 0 in 0.630s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:41:59 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-d5145bb2-15bd-4733-85fb-32a9c05d5eea tempest-VolumesSnapshotListTestJSON-1963164374 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a is being set with open permissions: ugo+rw Jun 02 00:41:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d5145bb2-15bd-4733-85fb-32a9c05d5eea tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:41:59 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a Jun 02 00:41:59 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:00 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d5145bb2-15bd-4733-85fb-32a9c05d5eea tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a" returned: 0 in 0.609s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d5145bb2-15bd-4733-85fb-32a9c05d5eea tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.907s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.180s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1530911533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2a273e-58c9-43ca-9c16-8c08f63e6b26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fefb2b4c5a7b474a9ab5dde875539311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:41:55Z,use_quota=True,user_id='f6b029beabf8494e8159a27ceb08f9d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:42:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Creating volume 9d2a273e-58c9-43ca-9c16-8c08f63e6b26 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:42:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:42:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:42:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:42:00 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:42:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:00 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 1073741824 Jun 02 00:42:00 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:00 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-d5145bb2-15bd-4733-85fb-32a9c05d5eea tempest-VolumesSnapshotListTestJSON-1963164374 None] Create snapshot completed successfully Jun 02 00:42:01 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 1073741824" returned: 0 in 0.742s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:01 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 Jun 02 00:42:01 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0c65aca8-5d50-4a1f-96e6-bae88a8b8b78 tempest-VolumesSnapshotListTestJSON-1963164374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:01 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26" returned: 0 in 0.575s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:42:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.395s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] Creating offline snapshot 29dba2f4-102c-4f9f-9c48-a2efa7781fc0 of volume 7ec82deb-9558-42fc-a77f-b453d328eb0c {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:42:01 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Attempting download of 1b93abc4-d162-4478-b919-a527963e0e4e ((None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}])) to volume 9d2a273e-58c9-43ca-9c16-8c08f63e6b26. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 00:42:01 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1d2186-55af-498f-ac2c-3a7491ed0a68]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:01 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fa9ab4-a533-4bfa-878c-1f8db30e9b15]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_jcbpbnw9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:01 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c Jun 02 00:42:01 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:01 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_jcbpbnw9 Jun 02 00:42:01 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:02 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_jcbpbnw9" returned: 0 in 0.683s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_jcbpbnw9 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:02 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c" returned: 0 in 0.736s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:02 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 1G Jun 02 00:42:02 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:02 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_jcbpbnw9 Jun 02 00:42:02 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:03 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_jcbpbnw9" returned: 1 in 0.687s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_jcbpbnw9' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:42:03 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d816e4a-1e7b-4611-af06-1f09ae6bca9d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_hwlqv9nndevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:03 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 1G" returned: 0 in 0.737s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec82deb-9558-42fc-a77f-b453d328eb0c -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:03 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec82deb-9558-42fc-a77f-b453d328eb0c -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 Jun 02 00:42:03 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:03 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_hwlqv9nndevstack@QuobyteHD Jun 02 00:42:03 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:03 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_hwlqv9nndevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:03 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] 1b93abc4-d162-4478-b919-a527963e0e4e was qcow2, converting to raw {{(pid=86910) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 00:42:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_hwlqv9nndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:03 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec82deb-9558-42fc-a77f-b453d328eb0c -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0" returned: 0 in 0.629s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:03 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 is being set with open permissions: ugo+rw Jun 02 00:42:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:03 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_hwlqv9nndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 Jun 02 00:42:03 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:03 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 Jun 02 00:42:03 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:04 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0" returned: 0 in 0.655s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:04 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.info Jun 02 00:42:04 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:05 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.info" returned: 0 in 0.692s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:05 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.info is being set with open permissions: ugo+rw Jun 02 00:42:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:05 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.info Jun 02 00:42:05 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:05 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.info" returned: 0 in 0.643s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:05 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.194s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0c65aca8-5d50-4a1f-96e6-bae88a8b8b78 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.392s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_hwlqv9nndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26" returned: 0 in 2.084s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:05 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_hwlqv9nndevstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:42:05 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Converted 112.00 MB image at 53.73 MB/s Jun 02 00:42:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-0c65aca8-5d50-4a1f-96e6-bae88a8b8b78 tempest-VolumesSnapshotListTestJSON-1963164374 None] Creating offline snapshot e846f65c-b458-46f8-ba12-e1173b98e77e of volume 24814925-f533-4207-8ce1-fc1fbb6b99cc {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:42:05 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 1G Jun 02 00:42:05 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:06 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31dded1-d38d-4984-a4fc-8f33b3c7f893]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0c65aca8-5d50-4a1f-96e6-bae88a8b8b78 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:06 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-12dd5611-5fc2-4f08-8fc7-7bef1fb71bf7 tempest-SnapshotsActionsTest-1985707000 None] Create snapshot completed successfully Jun 02 00:42:06 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a Jun 02 00:42:06 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:06 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 1G" returned: 0 in 0.686s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:06 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e859b0d8-dea7-4030-8d6c-0e426c763ca5]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:06 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 Jun 02 00:42:06 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:06 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0c65aca8-5d50-4a1f-96e6-bae88a8b8b78 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a" returned: 0 in 0.895s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:06 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-0c65aca8-5d50-4a1f-96e6-bae88a8b8b78 tempest-VolumesSnapshotListTestJSON-1963164374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24814925-f533-4207-8ce1-fc1fbb6b99cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0c65aca8-5d50-4a1f-96e6-bae88a8b8b78 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:06 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e 1G Jun 02 00:42:06 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fd77cba4-b890-4f93-ab24-d36f53a35d60 tempest-SnapshotsActionsTest-1985707000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:07 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26" returned: 0 in 0.891s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:07 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 Jun 02 00:42:07 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:07 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0c65aca8-5d50-4a1f-96e6-bae88a8b8b78 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e 1G" returned: 0 in 0.974s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0c65aca8-5d50-4a1f-96e6-bae88a8b8b78 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:07 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e Jun 02 00:42:07 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:08 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26" returned: 1 in 0.722s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:42:08 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Downloaded image 1b93abc4-d162-4478-b919-a527963e0e4e ((None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}])) to volume 9d2a273e-58c9-43ca-9c16-8c08f63e6b26 successfully. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 00:42:08 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Temporary image 1b93abc4-d162-4478-b919-a527963e0e4e for user f6b029beabf8494e8159a27ceb08f9d9 is deleted. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 00:42:08 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Marking volume 9d2a273e-58c9-43ca-9c16-8c08f63e6b26 as bootable. {{(pid=86910) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 00:42:08 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Copying metadata from image 1b93abc4-d162-4478-b919-a527963e0e4e to 9d2a273e-58c9-43ca-9c16-8c08f63e6b26. {{(pid=86910) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 00:42:08 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Creating volume glance metadata for volume 9d2a273e-58c9-43ca-9c16-8c08f63e6b26 backed by image 1b93abc4-d162-4478-b919-a527963e0e4e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86910) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 00:42:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d292cda-6b1a-4555-8721-6207f93befa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26', 'volume_size': 1, 'image_id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '213591b260fd4db58e9aae1daeaec391', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'created_at': datetime.datetime(2026, 6, 1, 22, 25, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 25, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b93abc4-d162-4478-b919-a527963e0e4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9618025e-2f53-4b68-a92d-84ac260bdd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:08 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Volume volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 (9d2a273e-58c9-43ca-9c16-8c08f63e6b26): created successfully Jun 02 00:42:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9618025e-2f53-4b68-a92d-84ac260bdd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Flow 'volume_create_manager' (ad910874-3c0b-4e19-aaaa-a07a63eaa0e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:42:08 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a61c98c1-ab6d-4ac7-bae0-71b717188b87 tempest-VolumesImageMetadata-173616594 None] Created volume successfully. Jun 02 00:42:08 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0c65aca8-5d50-4a1f-96e6-bae88a8b8b78 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e" returned: 0 in 0.641s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:08 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-0c65aca8-5d50-4a1f-96e6-bae88a8b8b78 tempest-VolumesSnapshotListTestJSON-1963164374 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e is being set with open permissions: ugo+rw Jun 02 00:42:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0c65aca8-5d50-4a1f-96e6-bae88a8b8b78 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:08 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e Jun 02 00:42:08 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Acquiring lock "cinder-9d2a273e-58c9-43ca-9c16-8c08f63e6b26-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Lock "cinder-9d2a273e-58c9-43ca-9c16-8c08f63e6b26-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Acquiring lock "cinder-quobyte-9d2a273e-58c9-43ca-9c16-8c08f63e6b26" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:09 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Lock "cinder-quobyte-9d2a273e-58c9-43ca-9c16-8c08f63e6b26" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:09 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bb86ba-67cd-4595-82f0-8c821cfcbb5d]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:09 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0c65aca8-5d50-4a1f-96e6-bae88a8b8b78 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e" returned: 0 in 0.603s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0c65aca8-5d50-4a1f-96e6-bae88a8b8b78 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.227s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:09 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 Jun 02 00:42:09 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fd77cba4-b890-4f93-ab24-d36f53a35d60 tempest-SnapshotsActionsTest-1985707000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.735s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:09 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-fd77cba4-b890-4f93-ab24-d36f53a35d60 tempest-SnapshotsActionsTest-1985707000 None] Creating offline snapshot 58ad9f55-dd4b-4b5e-bbd3-023d18d87218 of volume 7ec82deb-9558-42fc-a77f-b453d328eb0c {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:42:09 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-0c65aca8-5d50-4a1f-96e6-bae88a8b8b78 tempest-VolumesSnapshotListTestJSON-1963164374 None] Create snapshot completed successfully Jun 02 00:42:09 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c62a345-c1d2-4dd0-96ec-be822f7ceb5f]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd77cba4-b890-4f93-ab24-d36f53a35d60 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:09 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 Jun 02 00:42:09 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:09 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26" returned: 0 in 0.738s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:09 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 Jun 02 00:42:09 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:10 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd77cba4-b890-4f93-ab24-d36f53a35d60 tempest-SnapshotsActionsTest-1985707000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0" returned: 0 in 0.810s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-fd77cba4-b890-4f93-ab24-d36f53a35d60 tempest-SnapshotsActionsTest-1985707000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec82deb-9558-42fc-a77f-b453d328eb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd77cba4-b890-4f93-ab24-d36f53a35d60 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:10 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218 1G Jun 02 00:42:10 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:10 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26" returned: 1 in 0.811s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:42:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:10 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26 Jun 02 00:42:10 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Acquiring lock "cinder-e846f65c-b458-46f8-ba12-e1173b98e77e-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-e846f65c-b458-46f8-ba12-e1173b98e77e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Acquiring lock "cinder-quobyte-24814925-f533-4207-8ce1-fc1fbb6b99cc" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-quobyte-24814925-f533-4207-8ce1-fc1fbb6b99cc" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Acquiring lock "cinder-quobyte-e846f65c-b458-46f8-ba12-e1173b98e77e" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-quobyte-e846f65c-b458-46f8-ba12-e1173b98e77e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Deleting offline snapshot e846f65c-b458-46f8-ba12-e1173b98e77e of volume 24814925-f533-4207-8ce1-fc1fbb6b99cc {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:42:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] snapshot_file for this snap is: volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:42:10 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e50a555-f3f3-4b83-85e2-2b58a1a6feb9]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-67cff3cc-50cd-4b2f-89f8-637079c03b28 req-ed0964e6-8578-47ae-b19e-6f013de0c27d tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:11 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e Jun 02 00:42:11 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:11 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd77cba4-b890-4f93-ab24-d36f53a35d60 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218 1G" returned: 0 in 0.986s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd77cba4-b890-4f93-ab24-d36f53a35d60 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:11 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218 Jun 02 00:42:11 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:11 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9d2a273e-58c9-43ca-9c16-8c08f63e6b26" returned: 0 in 0.654s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:11 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Lock "cinder-quobyte-9d2a273e-58c9-43ca-9c16-8c08f63e6b26" released by "delete_volume" :: held 2.265s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:11 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Created reservations ['af2e5002-eb4d-4234-8e26-c311101c216a', '400d79ad-d1aa-4d9e-a92d-0fe85e49309a', '7fbb2b76-32f2-4e21-a2aa-878871cc2af0', '25f9f648-1876-4a12-8361-0f80b9059300'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:42:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:11 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:42:11 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:42:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:11 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:42:11 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:11 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e" returned: 0 in 0.729s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:11 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24814925-f533-4207-8ce1-fc1fbb6b99cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:11 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c768c39f-89bb-44fc-99fc-6c666d2d9afc]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:11 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd77cba4-b890-4f93-ab24-d36f53a35d60 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218" returned: 0 in 0.706s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:11 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-fd77cba4-b890-4f93-ab24-d36f53a35d60 tempest-SnapshotsActionsTest-1985707000 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218 is being set with open permissions: ugo+rw Jun 02 00:42:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd77cba4-b890-4f93-ab24-d36f53a35d60 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:11 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218 Jun 02 00:42:11 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:11 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a Jun 02 00:42:11 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:11 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.598s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:42:12 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Deleted volume successfully. Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c83a8fd6-68a0-445c-bb60-63a1ea7f887b tempest-VolumesImageMetadata-173616594 None] Lock "cinder-9d2a273e-58c9-43ca-9c16-8c08f63e6b26-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:12 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fd77cba4-b890-4f93-ab24-d36f53a35d60 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218" returned: 0 in 0.643s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:12 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fd77cba4-b890-4f93-ab24-d36f53a35d60 tempest-SnapshotsActionsTest-1985707000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.270s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-67cff3cc-50cd-4b2f-89f8-637079c03b28 req-ed0964e6-8578-47ae-b19e-6f013de0c27d tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.474s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a" returned: 0 in 0.765s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24814925-f533-4207-8ce1-fc1fbb6b99cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7ff2c0-42d0-450b-a891-8b4f7c9b6a6e]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-67cff3cc-50cd-4b2f-89f8-637079c03b28 req-ed0964e6-8578-47ae-b19e-6f013de0c27d tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-21d11532-460a-4153-9fd3-75ffef8634c4 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:12 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e Jun 02 00:42:12 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:12 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-fd77cba4-b890-4f93-ab24-d36f53a35d60 tempest-SnapshotsActionsTest-1985707000 None] Create snapshot completed successfully Jun 02 00:42:12 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-21d11532-460a-4153-9fd3-75ffef8634c4 Jun 02 00:42:12 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Acquiring lock "cinder-58ad9f55-dd4b-4b5e-bbd3-023d18d87218-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-58ad9f55-dd4b-4b5e-bbd3-023d18d87218-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Acquiring lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Acquiring lock "cinder-quobyte-58ad9f55-dd4b-4b5e-bbd3-023d18d87218" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-quobyte-58ad9f55-dd4b-4b5e-bbd3-023d18d87218" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Deleting offline snapshot 58ad9f55-dd4b-4b5e-bbd3-023d18d87218 of volume 7ec82deb-9558-42fc-a77f-b453d328eb0c {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] snapshot_file for this snap is: volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a143bc-9b35-4248-8490-bcdd26e163a1]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:13 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218 Jun 02 00:42:13 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:13 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-67cff3cc-50cd-4b2f-89f8-637079c03b28 req-ed0964e6-8578-47ae-b19e-6f013de0c27d tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-21d11532-460a-4153-9fd3-75ffef8634c4" returned: 0 in 0.818s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-67cff3cc-50cd-4b2f-89f8-637079c03b28 req-ed0964e6-8578-47ae-b19e-6f013de0c27d tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.846s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-67cff3cc-50cd-4b2f-89f8-637079c03b28 req-ed0964e6-8578-47ae-b19e-6f013de0c27d tempest-TestInstancesWithCinderVolumes-1796681864 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-21d11532-460a-4153-9fd3-75ffef8634c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '421782ae-e1de-4c84-aed0-baf3ee6c4e40', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:42:13 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e" returned: 0 in 0.893s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:13 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e Jun 02 00:42:13 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:13 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-67cff3cc-50cd-4b2f-89f8-637079c03b28 req-ed0964e6-8578-47ae-b19e-6f013de0c27d tempest-TestInstancesWithCinderVolumes-1796681864 None] attachment_update completed successfully. Jun 02 00:42:13 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218" returned: 0 in 0.901s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec82deb-9558-42fc-a77f-b453d328eb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:13 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f57be91-185a-4534-a694-c533acd0cd84]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:14 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 Jun 02 00:42:14 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:14 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e846f65c-b458-46f8-ba12-e1173b98e77e" returned: 0 in 0.779s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-quobyte-e846f65c-b458-46f8-ba12-e1173b98e77e" released by "_delete_snapshot" :: held 3.284s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-quobyte-24814925-f533-4207-8ce1-fc1fbb6b99cc" released by "delete_snapshot" :: held 3.311s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:14 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Created reservations ['937d8fad-871d-48c4-9af8-1288233bff29', '693d9210-2fe2-46e4-aa72-c3f9ad94f4ff', '9bcf0ef8-c29e-4e1b-a71c-05e562861a0c', '131998db-9fea-4165-9ba7-d8905a63c219'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:42:14 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Delete snapshot completed successfully. Jun 02 00:42:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-616ee89f-d7ad-40e1-9889-278dfd15d52a tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-e846f65c-b458-46f8-ba12-e1173b98e77e-delete_snapshot" released by "delete_snapshot" :: held 3.498s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:14 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0" returned: 0 in 0.771s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:14 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec82deb-9558-42fc-a77f-b453d328eb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:14 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218 Jun 02 00:42:14 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Acquiring lock "cinder-83741b6a-944e-4f7f-b236-db004a04ab8a-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-83741b6a-944e-4f7f-b236-db004a04ab8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Acquiring lock "cinder-quobyte-24814925-f533-4207-8ce1-fc1fbb6b99cc" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-quobyte-24814925-f533-4207-8ce1-fc1fbb6b99cc" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Acquiring lock "cinder-quobyte-83741b6a-944e-4f7f-b236-db004a04ab8a" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-quobyte-83741b6a-944e-4f7f-b236-db004a04ab8a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Deleting offline snapshot 83741b6a-944e-4f7f-b236-db004a04ab8a of volume 24814925-f533-4207-8ce1-fc1fbb6b99cc {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] snapshot_file for this snap is: volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[911daca0-c54e-416f-8c6c-3573d31468bc]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:15 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:42:15 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:15 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a Jun 02 00:42:15 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Flow 'volume_create_manager' (808d318e-c6a3-4c20-b0ec-7477de323ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5fc6ac1-adc9-4dbc-9adc-cdea8222586c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5fc6ac1-adc9-4dbc-9adc-cdea8222586c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1361604359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f16a03-ead2-4174-8709-2bcd5d5689e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88882a25c27462b866b1df83c55fb40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:42:15Z,use_quota=True,user_id='410dd9316d9345f7b2c64adb565cfa41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37d192e-3c70-463f-8f48-6de36cc0cb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37d192e-3c70-463f-8f48-6de36cc0cb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7acad63-763e-412b-adf2-215dbac67b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7acad63-763e-412b-adf2-215dbac67b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f16a03-ead2-4174-8709-2bcd5d5689e5', 'volume_name': 'volume-b2f16a03-ead2-4174-8709-2bcd5d5689e5', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683ebcad-6728-4733-ac06-0a3c5c50155e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683ebcad-6728-4733-ac06-0a3c5c50155e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63764d61-2667-4345-93b6-4cafe734e6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:15 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Volume b2f16a03-ead2-4174-8709-2bcd5d5689e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f16a03-ead2-4174-8709-2bcd5d5689e5', 'volume_size': 1} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1361604359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f16a03-ead2-4174-8709-2bcd5d5689e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88882a25c27462b866b1df83c55fb40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:42:15Z,use_quota=True,user_id='410dd9316d9345f7b2c64adb565cfa41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Creating volume b2f16a03-ead2-4174-8709-2bcd5d5689e5 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:42:15 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b2f16a03-ead2-4174-8709-2bcd5d5689e5 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:15 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218" returned: 0 in 0.856s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:15 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b2f16a03-ead2-4174-8709-2bcd5d5689e5 1073741824 Jun 02 00:42:15 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:15 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218 Jun 02 00:42:15 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:16 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.804s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:16 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:42:16 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a" returned: 0 in 0.865s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24814925-f533-4207-8ce1-fc1fbb6b99cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:16 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5aca6be-b4ff-4323-8d2b-d8a1edea3e8b]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:16 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 Jun 02 00:42:16 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:16 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.58ad9f55-dd4b-4b5e-bbd3-023d18d87218" returned: 0 in 0.706s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-quobyte-58ad9f55-dd4b-4b5e-bbd3-023d18d87218" released by "_delete_snapshot" :: held 3.371s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" released by "delete_snapshot" :: held 3.403s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:16 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Created reservations ['38a31936-0937-4795-b416-dfd69961de78', '5fcb4187-6cb0-4071-a50b-1cdb70ed09e8', 'c02b2fc1-0e4b-4531-8885-ee8f78581337', 'a5336916-dafc-486a-81ea-063499894d12'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:42:16 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Delete snapshot completed successfully. Jun 02 00:42:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b3c4c08d-e2a6-4d70-b8e9-075f026b3276 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-58ad9f55-dd4b-4b5e-bbd3-023d18d87218-delete_snapshot" released by "delete_snapshot" :: held 3.589s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:16 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b2f16a03-ead2-4174-8709-2bcd5d5689e5 1073741824" returned: 0 in 0.937s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b2f16a03-ead2-4174-8709-2bcd5d5689e5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:16 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b2f16a03-ead2-4174-8709-2bcd5d5689e5 Jun 02 00:42:16 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:16 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60" returned: 0 in 0.774s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24814925-f533-4207-8ce1-fc1fbb6b99cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:16 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a Jun 02 00:42:16 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:17 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b2f16a03-ead2-4174-8709-2bcd5d5689e5" returned: 0 in 0.630s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:17 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:42:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63764d61-2667-4345-93b6-4cafe734e6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f16a03-ead2-4174-8709-2bcd5d5689e5', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e65a03-b580-4db2-8b93-2b39b31c7eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:17 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Volume volume-b2f16a03-ead2-4174-8709-2bcd5d5689e5 (b2f16a03-ead2-4174-8709-2bcd5d5689e5): created successfully Jun 02 00:42:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e65a03-b580-4db2-8b93-2b39b31c7eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Flow 'volume_create_manager' (808d318e-c6a3-4c20-b0ec-7477de323ea5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:42:17 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-5b5e7999-c470-4472-a7fc-a142920efbb6 tempest-VolumesMetadataTest-309592226 None] Created volume successfully. Jun 02 00:42:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a4f02557-5b8e-4572-9564-edbb73ac2326 tempest-SnapshotsActionsTest-1985707000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a4f02557-5b8e-4572-9564-edbb73ac2326 tempest-SnapshotsActionsTest-1985707000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:17 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-a4f02557-5b8e-4572-9564-edbb73ac2326 tempest-SnapshotsActionsTest-1985707000 None] Creating offline snapshot 54b6e44a-4b8c-45a7-9f0f-730eca3221a3 of volume 7ec82deb-9558-42fc-a77f-b453d328eb0c {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:42:17 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce20370-52a2-4071-8e45-9714f9250a31]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a4f02557-5b8e-4572-9564-edbb73ac2326 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:17 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 Jun 02 00:42:17 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:17 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a" returned: 0 in 0.851s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:17 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a Jun 02 00:42:17 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:18 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a4f02557-5b8e-4572-9564-edbb73ac2326 tempest-SnapshotsActionsTest-1985707000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0" returned: 0 in 0.802s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-a4f02557-5b8e-4572-9564-edbb73ac2326 tempest-SnapshotsActionsTest-1985707000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec82deb-9558-42fc-a77f-b453d328eb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a4f02557-5b8e-4572-9564-edbb73ac2326 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:18 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3 1G Jun 02 00:42:18 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:18 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] Acquiring lock "cinder-b2f16a03-ead2-4174-8709-2bcd5d5689e5-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:18 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] Lock "cinder-b2f16a03-ead2-4174-8709-2bcd5d5689e5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:18 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] Acquiring lock "cinder-quobyte-b2f16a03-ead2-4174-8709-2bcd5d5689e5" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:18 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] Lock "cinder-quobyte-b2f16a03-ead2-4174-8709-2bcd5d5689e5" acquired by "delete_volume" :: waited 0.027s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:18 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[34512139-5dc6-489a-9d5b-db0dee7c4961]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b2f16a03-ead2-4174-8709-2bcd5d5689e5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:18 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.83741b6a-944e-4f7f-b236-db004a04ab8a" returned: 0 in 0.743s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:18 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-quobyte-83741b6a-944e-4f7f-b236-db004a04ab8a" released by "_delete_snapshot" :: held 3.355s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:18 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-quobyte-24814925-f533-4207-8ce1-fc1fbb6b99cc" released by "delete_snapshot" :: held 3.391s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:18 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b2f16a03-ead2-4174-8709-2bcd5d5689e5 Jun 02 00:42:18 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:18 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Created reservations ['056572b2-5ca1-465e-8890-ba2bc2f0d48a', '4087167f-ec9d-4d03-8a95-8a625169130b', 'f5d3ac4d-e62b-40a5-a92c-04d6a644dda3', '29162b81-131a-4bba-9734-abd6d838f212'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:42:18 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Delete snapshot completed successfully. Jun 02 00:42:18 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3d33d8dd-d898-483d-a84d-255992ba5d15 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-83741b6a-944e-4f7f-b236-db004a04ab8a-delete_snapshot" released by "delete_snapshot" :: held 3.612s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:19 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a4f02557-5b8e-4572-9564-edbb73ac2326 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3 1G" returned: 0 in 0.847s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a4f02557-5b8e-4572-9564-edbb73ac2326 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:19 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3 Jun 02 00:42:19 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:19 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b2f16a03-ead2-4174-8709-2bcd5d5689e5" returned: 0 in 0.807s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b2f16a03-ead2-4174-8709-2bcd5d5689e5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:19 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b2f16a03-ead2-4174-8709-2bcd5d5689e5 Jun 02 00:42:19 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] Acquiring lock "cinder-e1694607-522c-471d-ac37-9bdfa9775c60-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-e1694607-522c-471d-ac37-9bdfa9775c60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] Acquiring lock "cinder-quobyte-24814925-f533-4207-8ce1-fc1fbb6b99cc" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-quobyte-24814925-f533-4207-8ce1-fc1fbb6b99cc" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] Acquiring lock "cinder-quobyte-e1694607-522c-471d-ac37-9bdfa9775c60" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-quobyte-e1694607-522c-471d-ac37-9bdfa9775c60" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] Deleting offline snapshot e1694607-522c-471d-ac37-9bdfa9775c60 of volume 24814925-f533-4207-8ce1-fc1fbb6b99cc {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] snapshot_file for this snap is: volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2acfc5-ddc0-4f48-adde-2f780324458e]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:19 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 Jun 02 00:42:19 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:19 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a4f02557-5b8e-4572-9564-edbb73ac2326 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3" returned: 0 in 0.729s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:19 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-a4f02557-5b8e-4572-9564-edbb73ac2326 tempest-SnapshotsActionsTest-1985707000 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3 is being set with open permissions: ugo+rw Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a4f02557-5b8e-4572-9564-edbb73ac2326 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:19 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3 Jun 02 00:42:19 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:19 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b2f16a03-ead2-4174-8709-2bcd5d5689e5" returned: 0 in 0.694s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] Lock "cinder-quobyte-b2f16a03-ead2-4174-8709-2bcd5d5689e5" released by "delete_volume" :: held 1.549s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:20 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] Created reservations ['36a1d43b-afe7-4c51-bea8-7c4cb64d1f9f', '3958ba0b-e9dc-4a57-8de5-214db9a0f2c7', '320f4e3f-389d-4b9c-925b-9b8736cc7b1d', '860168fc-6ba0-4be0-b0a9-3871924f0e41'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:42:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:20 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:42:20 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:42:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:20 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:42:20 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:20 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60" returned: 0 in 0.751s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:20 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24814925-f533-4207-8ce1-fc1fbb6b99cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:20 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fda9015-619b-42f3-b09a-f52005c86b99]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:20 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc Jun 02 00:42:20 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:20 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a4f02557-5b8e-4572-9564-edbb73ac2326 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3" returned: 0 in 0.636s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a4f02557-5b8e-4572-9564-edbb73ac2326 tempest-SnapshotsActionsTest-1985707000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.139s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:20 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a4f02557-5b8e-4572-9564-edbb73ac2326 tempest-SnapshotsActionsTest-1985707000 None] Create snapshot completed successfully Jun 02 00:42:20 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.630s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:20 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:42:20 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] Deleted volume successfully. Jun 02 00:42:20 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c9fee5ee-bd4e-43da-aa47-4b206db1fcd5 tempest-VolumesMetadataTest-309592226 None] Lock "cinder-b2f16a03-ead2-4174-8709-2bcd5d5689e5-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:21 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc" returned: 0 in 0.768s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:21 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 Jun 02 00:42:21 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Acquiring lock "cinder-54b6e44a-4b8c-45a7-9f0f-730eca3221a3-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-54b6e44a-4b8c-45a7-9f0f-730eca3221a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Acquiring lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Acquiring lock "cinder-quobyte-54b6e44a-4b8c-45a7-9f0f-730eca3221a3" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-quobyte-54b6e44a-4b8c-45a7-9f0f-730eca3221a3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Deleting offline snapshot 54b6e44a-4b8c-45a7-9f0f-730eca3221a3 of volume 7ec82deb-9558-42fc-a77f-b453d328eb0c {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:42:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] snapshot_file for this snap is: volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:42:21 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8b45ad-306b-4cb6-9f2e-0e593848c9f9]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:21 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60" returned: 0 in 0.843s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:21 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60 Jun 02 00:42:21 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:21 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3 Jun 02 00:42:21 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-d6c051d4-6ac3-4d65-82c4-21607f035709 req-eed7c4c1-7c4a-4c3f-9273-be7394411cb5 tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-d6c051d4-6ac3-4d65-82c4-21607f035709 req-eed7c4c1-7c4a-4c3f-9273-be7394411cb5 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:22 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[15114855-141a-4e4f-9cfc-d4299eea4f53]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-d6c051d4-6ac3-4d65-82c4-21607f035709 req-eed7c4c1-7c4a-4c3f-9273-be7394411cb5 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-611b3974-a07c-4fba-b839-161f844a877f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:22 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-611b3974-a07c-4fba-b839-161f844a877f Jun 02 00:42:22 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:22 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc.e1694607-522c-471d-ac37-9bdfa9775c60" returned: 0 in 0.734s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:22 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-quobyte-e1694607-522c-471d-ac37-9bdfa9775c60" released by "_delete_snapshot" :: held 3.244s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:22 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-quobyte-24814925-f533-4207-8ce1-fc1fbb6b99cc" released by "delete_snapshot" :: held 3.276s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:22 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3" returned: 0 in 0.896s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:22 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec82deb-9558-42fc-a77f-b453d328eb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:22 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] Created reservations ['cd4b6c29-435e-47ee-815d-b42a25b57d7a', 'd51e9198-cb26-4a5f-9d1d-801e1f11db77', '3f94c9e0-a291-422b-ae6d-6610e839193a', 'c5792e41-3d41-4205-b6b7-4ec3b2e0532d'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:42:22 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf2651d-638a-49fb-99db-520706585b97]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:22 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] Delete snapshot completed successfully. Jun 02 00:42:22 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e711bab8-673a-4c66-9bb6-0ed5acdd7168 tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-e1694607-522c-471d-ac37-9bdfa9775c60-delete_snapshot" released by "delete_snapshot" :: held 3.487s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:22 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 Jun 02 00:42:22 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:22 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-d6c051d4-6ac3-4d65-82c4-21607f035709 req-eed7c4c1-7c4a-4c3f-9273-be7394411cb5 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-611b3974-a07c-4fba-b839-161f844a877f" returned: 0 in 0.887s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-d6c051d4-6ac3-4d65-82c4-21607f035709 req-eed7c4c1-7c4a-4c3f-9273-be7394411cb5 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.911s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-d6c051d4-6ac3-4d65-82c4-21607f035709 req-eed7c4c1-7c4a-4c3f-9273-be7394411cb5 tempest-TestInstancesWithCinderVolumes-1796681864 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-611b3974-a07c-4fba-b839-161f844a877f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90b243dd-4b8c-408b-9d68-ed0a14c0d8a1', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:42:23 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-d6c051d4-6ac3-4d65-82c4-21607f035709 req-eed7c4c1-7c4a-4c3f-9273-be7394411cb5 tempest-TestInstancesWithCinderVolumes-1796681864 None] attachment_update completed successfully. Jun 02 00:42:23 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0" returned: 0 in 0.897s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec82deb-9558-42fc-a77f-b453d328eb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:23 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3 Jun 02 00:42:23 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] Acquiring lock "cinder-24814925-f533-4207-8ce1-fc1fbb6b99cc-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-24814925-f533-4207-8ce1-fc1fbb6b99cc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] Acquiring lock "cinder-quobyte-24814925-f533-4207-8ce1-fc1fbb6b99cc" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-quobyte-24814925-f533-4207-8ce1-fc1fbb6b99cc" acquired by "delete_volume" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:23 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5765c361-ff49-46aa-8d81-73f3743f85c7]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:24 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc Jun 02 00:42:24 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:24 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3" returned: 0 in 0.925s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:24 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3 Jun 02 00:42:24 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:24 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc" returned: 0 in 0.954s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:24 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc Jun 02 00:42:24 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:25 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.54b6e44a-4b8c-45a7-9f0f-730eca3221a3" returned: 0 in 0.650s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:25 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-quobyte-54b6e44a-4b8c-45a7-9f0f-730eca3221a3" released by "_delete_snapshot" :: held 3.523s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:25 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" released by "delete_snapshot" :: held 3.557s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:25 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Created reservations ['f2cfc994-c1ac-4219-9303-d764d644b768', 'e0ca5e59-6da4-4029-9372-0346b80725ef', '08073b26-e09b-4827-aca7-1143614f7d6f', '92572013-d6dd-4ba3-a9de-e38e2aba9384'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:42:25 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Delete snapshot completed successfully. Jun 02 00:42:25 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-36a97ddf-a12a-44fb-9663-7c237ced3e83 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-54b6e44a-4b8c-45a7-9f0f-730eca3221a3-delete_snapshot" released by "delete_snapshot" :: held 3.746s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:25 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24814925-f533-4207-8ce1-fc1fbb6b99cc" returned: 0 in 0.656s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:25 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-quobyte-24814925-f533-4207-8ce1-fc1fbb6b99cc" released by "delete_volume" :: held 1.705s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:25 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] Created reservations ['d137873c-6338-4a52-85ed-a5f3f4498e59', '4c7ba47b-60b8-4cef-9db6-c5d622f3eb42', '29e93ac8-c5e0-46a8-8522-9dc965b3231d', '2955d5dc-1f31-415d-a957-535b93d93120'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:42:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:42:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:42:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:25 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:42:25 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fca7980c-2e5b-4ed8-a061-4b11f4efaef6 tempest-SnapshotsActionsTest-1985707000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fca7980c-2e5b-4ed8-a061-4b11f4efaef6 tempest-SnapshotsActionsTest-1985707000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-fca7980c-2e5b-4ed8-a061-4b11f4efaef6 tempest-SnapshotsActionsTest-1985707000 None] Creating offline snapshot 69c96b77-4e40-47c2-9908-2de23e25fdf2 of volume 7ec82deb-9558-42fc-a77f-b453d328eb0c {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:42:26 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d6e606-ba81-4bce-95a5-a388314bf763]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fca7980c-2e5b-4ed8-a061-4b11f4efaef6 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:26 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.737s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:26 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:42:26 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] Deleted volume successfully. Jun 02 00:42:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-70902692-96c1-4521-a627-b1192f58fbce tempest-VolumesSnapshotListTestJSON-1963164374 None] Lock "cinder-24814925-f533-4207-8ce1-fc1fbb6b99cc-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:26 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 Jun 02 00:42:26 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:27 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fca7980c-2e5b-4ed8-a061-4b11f4efaef6 tempest-SnapshotsActionsTest-1985707000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0" returned: 0 in 0.865s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-fca7980c-2e5b-4ed8-a061-4b11f4efaef6 tempest-SnapshotsActionsTest-1985707000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec82deb-9558-42fc-a77f-b453d328eb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fca7980c-2e5b-4ed8-a061-4b11f4efaef6 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:27 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2 1G Jun 02 00:42:27 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:28 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fca7980c-2e5b-4ed8-a061-4b11f4efaef6 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2 1G" returned: 0 in 0.898s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fca7980c-2e5b-4ed8-a061-4b11f4efaef6 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:28 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2 Jun 02 00:42:28 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:29 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fca7980c-2e5b-4ed8-a061-4b11f4efaef6 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2" returned: 0 in 0.920s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:29 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-fca7980c-2e5b-4ed8-a061-4b11f4efaef6 tempest-SnapshotsActionsTest-1985707000 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2 is being set with open permissions: ugo+rw Jun 02 00:42:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fca7980c-2e5b-4ed8-a061-4b11f4efaef6 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:29 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2 Jun 02 00:42:29 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:29 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:42:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Flow 'volume_create_manager' (e3b6fb9c-30aa-45a4-be2c-a9c5aebfa766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:42:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2579c709-6097-41a8-8698-4e784c48563a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2579c709-6097-41a8-8698-4e784c48563a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-535606462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1459612-61fa-4d5c-8d3d-7980b2367ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faca4c317213480e9dc95d9900f0d6ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:42:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:42:30Z,use_quota=True,user_id='b59fc5b9739049bc9054ae1de34415ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34148ff-f40a-4736-8e5f-1feb1da1f330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34148ff-f40a-4736-8e5f-1feb1da1f330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e41167-08f6-4525-8dc9-d292464e69d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e41167-08f6-4525-8dc9-d292464e69d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1459612-61fa-4d5c-8d3d-7980b2367ca2', 'volume_name': 'volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2', 'volume_size': 2}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99324a43-a1a9-4503-a9a7-5a5d12ffb8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99324a43-a1a9-4503-a9a7-5a5d12ffb8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749a2393-0c56-4510-bd0d-7d8298a93969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:29 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Volume b1459612-61fa-4d5c-8d3d-7980b2367ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2', 'volume_size': 2} Jun 02 00:42:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:30 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fca7980c-2e5b-4ed8-a061-4b11f4efaef6 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2" returned: 0 in 0.939s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fca7980c-2e5b-4ed8-a061-4b11f4efaef6 tempest-SnapshotsActionsTest-1985707000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.747s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.067s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-535606462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1459612-61fa-4d5c-8d3d-7980b2367ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faca4c317213480e9dc95d9900f0d6ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:42:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:42:30Z,use_quota=True,user_id='b59fc5b9739049bc9054ae1de34415ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Creating volume b1459612-61fa-4d5c-8d3d-7980b2367ca2 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:42:30 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2 2147483648 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:30 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-fca7980c-2e5b-4ed8-a061-4b11f4efaef6 tempest-SnapshotsActionsTest-1985707000 None] Create snapshot completed successfully Jun 02 00:42:30 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2 2147483648 Jun 02 00:42:30 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Acquiring lock "cinder-69c96b77-4e40-47c2-9908-2de23e25fdf2-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-69c96b77-4e40-47c2-9908-2de23e25fdf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Acquiring lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Acquiring lock "cinder-quobyte-69c96b77-4e40-47c2-9908-2de23e25fdf2" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-quobyte-69c96b77-4e40-47c2-9908-2de23e25fdf2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Deleting offline snapshot 69c96b77-4e40-47c2-9908-2de23e25fdf2 of volume 7ec82deb-9558-42fc-a77f-b453d328eb0c {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] snapshot_file for this snap is: volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[62842818-fc20-487b-85d2-ede923db81ad]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:31 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2 Jun 02 00:42:31 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:31 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2 2147483648" returned: 0 in 1.283s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:31 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2 Jun 02 00:42:31 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:31 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2" returned: 0 in 0.993s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:31 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec82deb-9558-42fc-a77f-b453d328eb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:31 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9606fafe-0c5e-4206-8f6a-70c99dacc23a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:32 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 Jun 02 00:42:32 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:32 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2" returned: 0 in 0.905s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:32 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] <== create_volume: return (2268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:42:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.271s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:32 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=150,cinder:SELECT=152,cinder:INSERT=46,cinder:DELETE=12 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:42:32 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749a2393-0c56-4510-bd0d-7d8298a93969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2', 'volume_size': 2}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:32 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc20863-f0b0-43e3-bf99-af6db23cce0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:32 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Volume volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2 (b1459612-61fa-4d5c-8d3d-7980b2367ca2): created successfully Jun 02 00:42:32 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc20863-f0b0-43e3-bf99-af6db23cce0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:32 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Flow 'volume_create_manager' (e3b6fb9c-30aa-45a4-be2c-a9c5aebfa766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:42:32 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-4e93b0cf-5407-4240-94ee-b4df75f34f16 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Created volume successfully. Jun 02 00:42:32 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0" returned: 0 in 0.936s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:32 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec82deb-9558-42fc-a77f-b453d328eb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:32 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2 Jun 02 00:42:32 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Creating offline snapshot f8774042-7180-4b9c-98ec-45e46678becc of volume b1459612-61fa-4d5c-8d3d-7980b2367ca2 {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e968bb-000b-41d9-9260-6a35079549b9]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:33 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2 Jun 02 00:42:33 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Flow 'volume_create_manager' (4c89240e-1f03-410d-a7ac-f868b2c0020d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31b6818-c54f-48ee-b60a-40d1126bfbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31b6818-c54f-48ee-b60a-40d1126bfbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-455960368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ece41e-c9fc-4e72-9acf-49bb7def3db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78912d11ab0148c49e1b2a62bf49a9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:42:34Z,use_quota=True,user_id='e54cfe286c4545549118aad82fc6f349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1969ff00-f13c-4513-a33f-6db51a481caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1969ff00-f13c-4513-a33f-6db51a481caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72ac928-54c8-4b43-af86-575797fd52b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72ac928-54c8-4b43-af86-575797fd52b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51ece41e-c9fc-4e72-9acf-49bb7def3db3', 'volume_name': 'volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a779e5-810c-4866-b8ca-16b12fad409b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a779e5-810c-4866-b8ca-16b12fad409b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cfedcb2-5e16-4cbe-a478-8b178a4c2081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:33 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Volume 51ece41e-c9fc-4e72-9acf-49bb7def3db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3', 'volume_size': 1} Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:33 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2" returned: 0 in 0.854s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:33 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2 Jun 02 00:42:33 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:33 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-61a391d0-7aa1-4e33-b73b-e40fd747b309 req-6a940c1a-ceba-485f-b144-3f6eaea8de05 tempest-TestInstancesWithCinderVolumes-1796681864 None] Terminate volume connection completed successfully. Jun 02 00:42:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-61a391d0-7aa1-4e33-b73b-e40fd747b309 req-6a940c1a-ceba-485f-b144-3f6eaea8de05 tempest-TestInstancesWithCinderVolumes-1796681864 None] Deleting attachment 421782ae-e1de-4c84-aed0-baf3ee6c4e40. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:42:34 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2" returned: 0 in 0.829s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc 2G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:34 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc 2G Jun 02 00:42:34 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:34 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.69c96b77-4e40-47c2-9908-2de23e25fdf2" returned: 0 in 0.606s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-quobyte-69c96b77-4e40-47c2-9908-2de23e25fdf2" released by "_delete_snapshot" :: held 3.538s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" released by "delete_snapshot" :: held 3.576s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:34 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Created reservations ['478be672-8a05-4e5c-963e-ec04418cb3b4', '46b8e664-fbcc-4b12-b61e-a7692ed21d86', 'a72ca844-e15c-41dd-939b-c34c74ae9112', '523bebfc-9394-4fd6-811f-45e997c6d530'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:42:34 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Delete snapshot completed successfully. Jun 02 00:42:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2bfb21a6-e548-4af8-b9d8-47d4155a0e95 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-69c96b77-4e40-47c2-9908-2de23e25fdf2-delete_snapshot" released by "delete_snapshot" :: held 3.732s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:34 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc 2G" returned: 0 in 0.741s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:34 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc Jun 02 00:42:34 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-32dd4ea8-4ef4-4384-afcd-660a7299cbc3 tempest-SnapshotsActionsTest-1985707000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:35 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc" returned: 0 in 0.645s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:35 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc is being set with open permissions: ugo+rw Jun 02 00:42:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:35 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc Jun 02 00:42:35 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "cinder-21d11532-460a-4153-9fd3-75ffef8634c4-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "cinder-21d11532-460a-4153-9fd3-75ffef8634c4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "cinder-quobyte-21d11532-460a-4153-9fd3-75ffef8634c4" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "cinder-quobyte-21d11532-460a-4153-9fd3-75ffef8634c4" acquired by "delete_volume" :: waited 0.016s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:35 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[157fee9e-39a8-4f9a-9494-77a289920b0f]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-21d11532-460a-4153-9fd3-75ffef8634c4 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:35 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-21d11532-460a-4153-9fd3-75ffef8634c4 Jun 02 00:42:35 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:36 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc" returned: 0 in 0.638s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:36 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.info Jun 02 00:42:36 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:36 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-21d11532-460a-4153-9fd3-75ffef8634c4" returned: 0 in 0.744s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-21d11532-460a-4153-9fd3-75ffef8634c4 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:36 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-21d11532-460a-4153-9fd3-75ffef8634c4 Jun 02 00:42:36 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:36 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.info" returned: 0 in 0.693s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:36 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.info is being set with open permissions: ugo+rw Jun 02 00:42:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:36 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.info Jun 02 00:42:36 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:37 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-21d11532-460a-4153-9fd3-75ffef8634c4" returned: 0 in 0.598s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "cinder-quobyte-21d11532-460a-4153-9fd3-75ffef8634c4" released by "delete_volume" :: held 1.399s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:37 devstack cinder-volume[86910]: WARNING cinder.quota [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-217611666-1337596256 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-217611666-1337596256, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:42:37 devstack cinder-volume[86910]: WARNING cinder.quota [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-217611666-1337596256 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-217611666-1337596256, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Created reservations ['0f751b3f-a19f-423b-b0c9-3c63f00988c2', 'aeb84735-4341-4857-bfe7-0c4a59b83d5b', 'b9395453-40f4-4553-9b25-87dbb8b63331', '212ce325-b1bc-4fec-abc4-75cf29898004'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:37 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:42:37 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:37 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.info" returned: 0 in 0.693s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.348s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.957s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-455960368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ece41e-c9fc-4e72-9acf-49bb7def3db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78912d11ab0148c49e1b2a62bf49a9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:42:34Z,use_quota=True,user_id='e54cfe286c4545549118aad82fc6f349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Creating volume 51ece41e-c9fc-4e72-9acf-49bb7def3db3 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:42:37 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:42:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:37 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 1073741824 Jun 02 00:42:37 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:37 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-83a601d0-48e3-4720-a4e2-67725f05d6da tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Create snapshot completed successfully Jun 02 00:42:38 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.692s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:38 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:42:38 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Deleted volume successfully. Jun 02 00:42:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-0b4e63dd-f290-4d3e-9784-3da0978db5c3 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "cinder-21d11532-460a-4153-9fd3-75ffef8634c4-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:38 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 1073741824" returned: 0 in 0.868s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:38 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:INSERT=40,cinder:SELECT=123,cinder:UPDATE=140,cinder:DELETE=11 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:42:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:38 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 Jun 02 00:42:38 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Acquiring lock "cinder-f8774042-7180-4b9c-98ec-45e46678becc-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "cinder-f8774042-7180-4b9c-98ec-45e46678becc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Acquiring lock "cinder-quobyte-b1459612-61fa-4d5c-8d3d-7980b2367ca2" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "cinder-quobyte-b1459612-61fa-4d5c-8d3d-7980b2367ca2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Acquiring lock "cinder-quobyte-f8774042-7180-4b9c-98ec-45e46678becc" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "cinder-quobyte-f8774042-7180-4b9c-98ec-45e46678becc" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:38 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Deleting offline snapshot f8774042-7180-4b9c-98ec-45e46678becc of volume b1459612-61fa-4d5c-8d3d-7980b2367ca2 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:42:38 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] snapshot_file for this snap is: volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:42:38 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e858734-a157-49f3-8c67-e52a6bd8bd68]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:38 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc Jun 02 00:42:38 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:39 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3" returned: 0 in 0.670s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:39 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:42:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-32dd4ea8-4ef4-4384-afcd-660a7299cbc3 tempest-SnapshotsActionsTest-1985707000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.942s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:39 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cfedcb2-5e16-4cbe-a478-8b178a4c2081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:39 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f86ecb7-2eb3-4085-b7a4-404606dc85c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:42:39 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-32dd4ea8-4ef4-4384-afcd-660a7299cbc3 tempest-SnapshotsActionsTest-1985707000 None] Creating offline snapshot f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66 of volume 7ec82deb-9558-42fc-a77f-b453d328eb0c {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:42:39 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Volume volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 (51ece41e-c9fc-4e72-9acf-49bb7def3db3): created successfully Jun 02 00:42:39 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f86ecb7-2eb3-4085-b7a4-404606dc85c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:42:39 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Flow 'volume_create_manager' (4c89240e-1f03-410d-a7ac-f868b2c0020d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:42:39 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0a1010-c676-4e77-bd7e-0214df836eb5]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-32dd4ea8-4ef4-4384-afcd-660a7299cbc3 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:39 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-1fc5ffb9-48bd-4829-88cd-0cfaafa26a80 tempest-VolumesActionsTest-1574590668 None] Created volume successfully. Jun 02 00:42:39 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 Jun 02 00:42:39 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:39 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc" returned: 0 in 0.806s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:39 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:39 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f74d8a-74d5-43c4-8de9-3b64cff00d61]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:39 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2 Jun 02 00:42:39 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:40 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-32dd4ea8-4ef4-4384-afcd-660a7299cbc3 tempest-SnapshotsActionsTest-1985707000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0" returned: 0 in 0.801s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-32dd4ea8-4ef4-4384-afcd-660a7299cbc3 tempest-SnapshotsActionsTest-1985707000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec82deb-9558-42fc-a77f-b453d328eb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-32dd4ea8-4ef4-4384-afcd-660a7299cbc3 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:40 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66 1G Jun 02 00:42:40 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:40 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2" returned: 0 in 0.772s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:40 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc Jun 02 00:42:40 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:40 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-aa6eea40-a590-44f5-9ba4-1d3ff57b8567 req-15debcb7-e3c5-4ed7-b059-50dff8fc0781 tempest-TestInstancesWithCinderVolumes-1796681864 None] Terminate volume connection completed successfully. Jun 02 00:42:40 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-aa6eea40-a590-44f5-9ba4-1d3ff57b8567 req-15debcb7-e3c5-4ed7-b059-50dff8fc0781 tempest-TestInstancesWithCinderVolumes-1796681864 None] Deleting attachment 90b243dd-4b8c-408b-9d68-ed0a14c0d8a1. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:42:41 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-32dd4ea8-4ef4-4384-afcd-660a7299cbc3 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66 1G" returned: 0 in 0.868s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-32dd4ea8-4ef4-4384-afcd-660a7299cbc3 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:41 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66 Jun 02 00:42:41 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:41 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc" returned: 0 in 0.793s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:41 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc Jun 02 00:42:41 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:41 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-32dd4ea8-4ef4-4384-afcd-660a7299cbc3 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66" returned: 0 in 0.740s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:41 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-32dd4ea8-4ef4-4384-afcd-660a7299cbc3 tempest-SnapshotsActionsTest-1985707000 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66 is being set with open permissions: ugo+rw Jun 02 00:42:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-32dd4ea8-4ef4-4384-afcd-660a7299cbc3 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:41 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66 Jun 02 00:42:41 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:41 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2.f8774042-7180-4b9c-98ec-45e46678becc" returned: 0 in 0.667s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "cinder-quobyte-f8774042-7180-4b9c-98ec-45e46678becc" released by "_delete_snapshot" :: held 3.167s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "cinder-quobyte-b1459612-61fa-4d5c-8d3d-7980b2367ca2" released by "delete_snapshot" :: held 3.195s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:41 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Created reservations ['c3991b14-4c91-455a-b062-73b4c7c083eb', 'dfa332de-e7ee-424e-9d34-f031da7ec087', 'f37b6886-3b78-4c28-b1b5-024e451eaffd', '0884959b-7a36-4a36-98bc-2b4f353a743c'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:42:41 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Delete snapshot completed successfully. Jun 02 00:42:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f5070536-a365-4bf4-a5ba-9496707d0dd4 tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "cinder-f8774042-7180-4b9c-98ec-45e46678becc-delete_snapshot" released by "delete_snapshot" :: held 3.327s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "cinder-611b3974-a07c-4fba-b839-161f844a877f-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "cinder-611b3974-a07c-4fba-b839-161f844a877f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:42 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-32dd4ea8-4ef4-4384-afcd-660a7299cbc3 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66" returned: 0 in 0.633s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-32dd4ea8-4ef4-4384-afcd-660a7299cbc3 tempest-SnapshotsActionsTest-1985707000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.177s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "cinder-quobyte-611b3974-a07c-4fba-b839-161f844a877f" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "cinder-quobyte-611b3974-a07c-4fba-b839-161f844a877f" acquired by "delete_volume" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:42 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-32dd4ea8-4ef4-4384-afcd-660a7299cbc3 tempest-SnapshotsActionsTest-1985707000 None] Create snapshot completed successfully Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f754d0-7c34-4968-a473-39619bbe9d29]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-611b3974-a07c-4fba-b839-161f844a877f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:42 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-611b3974-a07c-4fba-b839-161f844a877f Jun 02 00:42:42 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Acquiring lock "cinder-f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Acquiring lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Acquiring lock "cinder-quobyte-f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-quobyte-f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Deleting offline snapshot f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66 of volume 7ec82deb-9558-42fc-a77f-b453d328eb0c {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] snapshot_file for this snap is: volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b9d09c-6aed-4fd3-9c4c-e15eb180c75c]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:43 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66 Jun 02 00:42:43 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Acquiring lock "cinder-b1459612-61fa-4d5c-8d3d-7980b2367ca2-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "cinder-b1459612-61fa-4d5c-8d3d-7980b2367ca2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Acquiring lock "cinder-quobyte-b1459612-61fa-4d5c-8d3d-7980b2367ca2" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "cinder-quobyte-b1459612-61fa-4d5c-8d3d-7980b2367ca2" acquired by "delete_volume" :: waited 0.022s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:43 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb60e0d5-576b-46bb-add2-86d9dfc8c728]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:43 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2 Jun 02 00:42:43 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:43 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-611b3974-a07c-4fba-b839-161f844a877f" returned: 0 in 0.930s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-611b3974-a07c-4fba-b839-161f844a877f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:43 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-611b3974-a07c-4fba-b839-161f844a877f Jun 02 00:42:43 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:43 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66" returned: 0 in 1.048s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec82deb-9558-42fc-a77f-b453d328eb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:43 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8b628b-c546-4d69-ab3c-860de02a83d8]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:44 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 Jun 02 00:42:44 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:44 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2" returned: 0 in 1.045s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:44 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-611b3974-a07c-4fba-b839-161f844a877f" returned: 0 in 0.827s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:44 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2 Jun 02 00:42:44 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "cinder-quobyte-611b3974-a07c-4fba-b839-161f844a877f" released by "delete_volume" :: held 1.820s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:44 devstack cinder-volume[86910]: WARNING cinder.quota [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-542161126-2051929634 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-542161126-2051929634, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:42:44 devstack cinder-volume[86910]: WARNING cinder.quota [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-542161126-2051929634 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-542161126-2051929634, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:42:44 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Created reservations ['ef22e263-f9cd-4766-a96f-0bf4c423a35c', 'e642eb04-89c0-4c2a-9648-668ce8784221', 'e6250637-51ff-42a5-956b-22f73dc8a57b', 'f60c9dfa-15d0-472a-b046-ad10acf9b4fb'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:42:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:42:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:42:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:44 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:42:44 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:45 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0" returned: 0 in 1.135s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec82deb-9558-42fc-a77f-b453d328eb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:45 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:45 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66 Jun 02 00:42:45 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b1459612-61fa-4d5c-8d3d-7980b2367ca2" returned: 0 in 0.860s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "cinder-quobyte-b1459612-61fa-4d5c-8d3d-7980b2367ca2" released by "delete_volume" :: held 2.003s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:45 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Created reservations ['64f3c04c-c055-43d0-88b3-174236118591', '0c56a3db-8753-47e7-b1bc-ce2307620acd', '3ed5bf9c-25fb-4621-ad61-4f9f2a425bd0', '6d771e50-16bb-4715-b4a4-d266b7dafd12'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:42:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:42:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:42:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:45 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.889s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:45 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:42:45 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:42:45 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:45 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Deleted volume successfully. Jun 02 00:42:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2fc36b44-3c2f-4c95-85ff-a30ca926a9ca tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "cinder-611b3974-a07c-4fba-b839-161f844a877f-delete_volume" released by "delete_volume" :: held 3.073s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:46 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.761s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:46 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:42:46 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Deleted volume successfully. Jun 02 00:42:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bac17ecb-9627-46d9-91e1-582d9a8715fb tempest-VolumesSnapshotNegativeTestJSON-1796905828 None] Lock "cinder-b1459612-61fa-4d5c-8d3d-7980b2367ca2-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:46 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66" returned: 0 in 1.124s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:46 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66 Jun 02 00:42:46 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:47 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66" returned: 0 in 1.006s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-quobyte-f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66" released by "_delete_snapshot" :: held 4.471s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" released by "delete_snapshot" :: held 4.499s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:47 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Created reservations ['b30073ed-c401-4927-a085-e0532ec551c0', '88aaad17-3aad-470b-b3eb-163041fbf624', 'd096a047-581e-4bc0-bfc2-0267a03d3767', 'e1105083-6b2d-470f-8dd2-4a667e43515e'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:42:47 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Delete snapshot completed successfully. Jun 02 00:42:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-aa48ffd3-f2b1-458d-be4a-13006eb0dc56 tempest-SnapshotsActionsTest-1953316021 None] Lock "cinder-f8f3a5a4-5d23-4d4b-9330-0cf54ebc1b66-delete_snapshot" released by "delete_snapshot" :: held 4.668s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:48 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] Acquiring lock "cinder-29dba2f4-102c-4f9f-9c48-a2efa7781fc0-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:48 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] Lock "cinder-29dba2f4-102c-4f9f-9c48-a2efa7781fc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:48 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] Acquiring lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:48 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] Lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:48 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] Acquiring lock "cinder-quobyte-29dba2f4-102c-4f9f-9c48-a2efa7781fc0" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:48 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] Lock "cinder-quobyte-29dba2f4-102c-4f9f-9c48-a2efa7781fc0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:48 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] Deleting offline snapshot 29dba2f4-102c-4f9f-9c48-a2efa7781fc0 of volume 7ec82deb-9558-42fc-a77f-b453d328eb0c {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:42:48 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] snapshot_file for this snap is: volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:42:48 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9c669e-9bf0-42ec-853b-7d93ca3d38b8]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:48 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 Jun 02 00:42:48 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:49 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0" returned: 0 in 0.875s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec82deb-9558-42fc-a77f-b453d328eb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:42:49 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff36f20-6510-4ae9-82b7-efc06dbf0c0e]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:49 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c Jun 02 00:42:49 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:50 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c" returned: 0 in 0.769s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:50 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 Jun 02 00:42:50 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:50 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-4caaf7d0-7eb0-4265-9f1a-2b2ed81c2942 req-8cfeadf4-2bde-4637-b172-d8487541eaf5 tempest-TestInstancesWithCinderVolumes-1796681864 None] Terminate volume connection completed successfully. Jun 02 00:42:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-4caaf7d0-7eb0-4265-9f1a-2b2ed81c2942 req-8cfeadf4-2bde-4637-b172-d8487541eaf5 tempest-TestInstancesWithCinderVolumes-1796681864 None] Deleting attachment cdfdb90b-502d-43f4-a40a-d2cbc518bde6. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:42:51 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0" returned: 0 in 0.871s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:51 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0 Jun 02 00:42:51 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:52 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c.29dba2f4-102c-4f9f-9c48-a2efa7781fc0" returned: 0 in 0.732s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:52 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] Lock "cinder-quobyte-29dba2f4-102c-4f9f-9c48-a2efa7781fc0" released by "_delete_snapshot" :: held 3.394s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:52 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] Lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" released by "delete_snapshot" :: held 3.422s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:52 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] Created reservations ['b48817e2-7c1b-4169-b2bc-bc8e7faddc23', 'beaa8c4f-adfe-4f93-9b60-998bd752322a', '532f5e2b-6e9a-4385-b92d-5664636c6f4d', '37b942b8-1bfc-4368-94a0-9cdee9d3acfc'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:42:52 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] Delete snapshot completed successfully. Jun 02 00:42:52 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5cfc9fcf-2e15-4aaa-acd4-48a604e64bf1 tempest-SnapshotsActionsTest-1985707000 None] Lock "cinder-29dba2f4-102c-4f9f-9c48-a2efa7781fc0-delete_snapshot" released by "delete_snapshot" :: held 3.564s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:52 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] Acquiring lock "cinder-7ec82deb-9558-42fc-a77f-b453d328eb0c-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:52 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] Lock "cinder-7ec82deb-9558-42fc-a77f-b453d328eb0c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:53 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] Acquiring lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:53 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] Lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" acquired by "delete_volume" :: waited 0.035s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:53 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2936fc1-4de2-4ece-a109-9f954d258d56]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:53 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c Jun 02 00:42:53 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:54 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "cinder-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:54 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "cinder-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:54 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "cinder-quobyte-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:54 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "cinder-quobyte-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:54 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c" returned: 0 in 1.512s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:54 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9f414c-49bd-4b12-98b6-8f14df1380c9]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:42:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:54 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c Jun 02 00:42:54 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:54 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d Jun 02 00:42:54 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:55 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d" returned: 0 in 1.049s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:55 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7ec82deb-9558-42fc-a77f-b453d328eb0c" returned: 0 in 1.155s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:55 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] Lock "cinder-quobyte-7ec82deb-9558-42fc-a77f-b453d328eb0c" released by "delete_volume" :: held 2.856s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:55 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d Jun 02 00:42:55 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:56 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] Created reservations ['28b70647-5d09-4b67-b497-15806295ea26', '2295b8ca-9e43-4baf-b407-60900c1c734f', '997ab2f0-1d07-4c12-9125-1ac82f99fe45', 'd6b1735f-b5a1-4c38-978f-f21f7cd589a6'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:42:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:42:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:42:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:56 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:42:56 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-05e40bb3-f488-4b67-9e1a-30f6fad98d02 tempest-VolumesActionsTest-1574590668 None] Acquiring lock "cinder-51ece41e-c9fc-4e72-9acf-49bb7def3db3" by "attach_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-05e40bb3-f488-4b67-9e1a-30f6fad98d02 tempest-VolumesActionsTest-1574590668 None] Lock "cinder-51ece41e-c9fc-4e72-9acf-49bb7def3db3" acquired by "attach_volume" :: waited 0.048s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:57 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-05e40bb3-f488-4b67-9e1a-30f6fad98d02 tempest-VolumesActionsTest-1574590668 None] Attaching volume 51ece41e-c9fc-4e72-9acf-49bb7def3db3 to instance cc5f9a9c-f86d-4f93-a19d-5f95aead5806 at mountpoint /dev/vdb on host None. Jun 02 00:42:57 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d" returned: 1 in 1.221s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:42:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:57 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-05e40bb3-f488-4b67-9e1a-30f6fad98d02 tempest-VolumesActionsTest-1574590668 None] Attach volume completed successfully. Jun 02 00:42:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-05e40bb3-f488-4b67-9e1a-30f6fad98d02 tempest-VolumesActionsTest-1574590668 None] Lock "cinder-51ece41e-c9fc-4e72-9acf-49bb7def3db3" released by "attach_volume" :: held 0.227s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:57 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d Jun 02 00:42:57 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:57 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.140s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:57 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:42:57 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] Deleted volume successfully. Jun 02 00:42:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5548a4e7-6c00-46c1-b733-775971b2d2b3 tempest-SnapshotsActionsTest-1985707000 None] Lock "cinder-7ec82deb-9558-42fc-a77f-b453d328eb0c-delete_volume" released by "delete_volume" :: held 4.299s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9a3244f1-5d66-4b9a-9504-3f3afa489877 tempest-VolumesActionsTest-1574590668 None] Acquiring lock "cinder-51ece41e-c9fc-4e72-9acf-49bb7def3db3-detach_volume" by "detach_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:42:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9a3244f1-5d66-4b9a-9504-3f3afa489877 tempest-VolumesActionsTest-1574590668 None] Lock "cinder-51ece41e-c9fc-4e72-9acf-49bb7def3db3-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:42:57 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-9a3244f1-5d66-4b9a-9504-3f3afa489877 tempest-VolumesActionsTest-1574590668 None] Detaching volume 51ece41e-c9fc-4e72-9acf-49bb7def3db3 from instance cc5f9a9c-f86d-4f93-a19d-5f95aead5806. Jun 02 00:42:57 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-9a3244f1-5d66-4b9a-9504-3f3afa489877 tempest-VolumesActionsTest-1574590668 None] Detach volume completed successfully. Jun 02 00:42:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9a3244f1-5d66-4b9a-9504-3f3afa489877 tempest-VolumesActionsTest-1574590668 None] Lock "cinder-51ece41e-c9fc-4e72-9acf-49bb7def3db3-detach_volume" released by "detach_volume" :: held 0.122s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:58 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d" returned: 0 in 1.143s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:58 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "cinder-quobyte-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d" released by "delete_volume" :: held 3.578s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:42:58 devstack cinder-volume[86910]: WARNING cinder.quota [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1657617844-1164877751 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1657617844-1164877751, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:42:58 devstack cinder-volume[86910]: WARNING cinder.quota [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1657617844-1164877751 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1657617844-1164877751, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:42:58 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Created reservations ['9b686a4d-eea1-439b-a0cf-409c3387e367', '8fa171dc-cf5a-4ba0-9407-7e909659ee9d', '9d6da6ca-11e8-4202-bd95-1c09dd3cc722', 'e8aa24e3-e436-43b3-876c-31e9f28d9f48'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:42:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:42:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:42:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:42:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:42:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:42:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:42:58 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:42:58 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:42:59 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Jun 02 00:42:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.092s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:42:59 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:42:59 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Deleted volume successfully. Jun 02 00:42:59 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-33b97b85-5d01-4edc-ad18-d492c27ac218 tempest-TestInstancesWithCinderVolumes-1796681864 None] Lock "cinder-e6f306f8-fc2b-4e08-bb9a-7138acf1a14d-delete_volume" released by "delete_volume" :: held 4.974s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:43:08 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=54,cinder:SELECT=44,cinder:INSERT=17,cinder:DELETE=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:43:09 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=74,cinder:SELECT=64,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:43:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:43:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:43:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:43:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:43:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:43:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:43:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:43:15 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:43:15 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:43:16 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Jun 02 00:43:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.897s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:43:16 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Flow 'volume_create_manager' (dc55f4ef-26b7-4e0e-9423-9b105b5c96e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89297e43-b241-42f7-bb66-58132a48ce5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89297e43-b241-42f7-bb66-58132a48ce5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-621604089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482e6ea3-9250-46a1-a25b-ea3fe8df2661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6358687b029c43a49f955372cb045883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:43:18Z,use_quota=True,user_id='26547e820c6e467cb09220fb959bea33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9105f08d-3ddd-472a-91e8-5a90988b4805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9105f08d-3ddd-472a-91e8-5a90988b4805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f01e983-5d98-4cea-9c0b-8a02c3de1b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f01e983-5d98-4cea-9c0b-8a02c3de1b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '482e6ea3-9250-46a1-a25b-ea3fe8df2661', 'volume_name': 'volume-482e6ea3-9250-46a1-a25b-ea3fe8df2661', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5093786-3a23-4a61-a3e5-07978c0bdf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5093786-3a23-4a61-a3e5-07978c0bdf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f025aea-0d29-45cb-8f49-a39e13c748d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:43:17 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Volume 482e6ea3-9250-46a1-a25b-ea3fe8df2661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-482e6ea3-9250-46a1-a25b-ea3fe8df2661', 'volume_size': 1} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-621604089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482e6ea3-9250-46a1-a25b-ea3fe8df2661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6358687b029c43a49f955372cb045883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:43:18Z,use_quota=True,user_id='26547e820c6e467cb09220fb959bea33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Creating volume 482e6ea3-9250-46a1-a25b-ea3fe8df2661 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:43:17 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:43:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-482e6ea3-9250-46a1-a25b-ea3fe8df2661 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:43:17 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-482e6ea3-9250-46a1-a25b-ea3fe8df2661 1073741824 Jun 02 00:43:17 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:43:18 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Jun 02 00:43:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-482e6ea3-9250-46a1-a25b-ea3fe8df2661 1073741824" returned: 0 in 0.988s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:43:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-482e6ea3-9250-46a1-a25b-ea3fe8df2661 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:43:18 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-482e6ea3-9250-46a1-a25b-ea3fe8df2661 Jun 02 00:43:18 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:43:19 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Jun 02 00:43:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-482e6ea3-9250-46a1-a25b-ea3fe8df2661" returned: 0 in 0.632s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:43:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:43:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:43:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f025aea-0d29-45cb-8f49-a39e13c748d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482e6ea3-9250-46a1-a25b-ea3fe8df2661', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:43:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a817d6-fb60-44ec-887f-cb93b5350c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:43:19 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Volume volume-482e6ea3-9250-46a1-a25b-ea3fe8df2661 (482e6ea3-9250-46a1-a25b-ea3fe8df2661): created successfully Jun 02 00:43:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a817d6-fb60-44ec-887f-cb93b5350c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:43:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Flow 'volume_create_manager' (dc55f4ef-26b7-4e0e-9423-9b105b5c96e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:43:19 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-3b5fc4cf-03f5-45ad-beaf-956e6be6450b tempest-VolumeQuotasNegativeTestJSON-153304099 None] Created volume successfully. Jun 02 00:43:20 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] Acquiring lock "cinder-482e6ea3-9250-46a1-a25b-ea3fe8df2661-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:43:20 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] Lock "cinder-482e6ea3-9250-46a1-a25b-ea3fe8df2661-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:43:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] Acquiring lock "cinder-quobyte-482e6ea3-9250-46a1-a25b-ea3fe8df2661" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:43:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] Lock "cinder-quobyte-482e6ea3-9250-46a1-a25b-ea3fe8df2661" acquired by "delete_volume" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:43:21 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f49a4a2-bcf4-4b83-8086-e524eabcbd52]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:43:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-482e6ea3-9250-46a1-a25b-ea3fe8df2661 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:43:21 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-482e6ea3-9250-46a1-a25b-ea3fe8df2661 Jun 02 00:43:21 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:43:21 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Jun 02 00:43:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-482e6ea3-9250-46a1-a25b-ea3fe8df2661" returned: 0 in 0.910s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:43:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-482e6ea3-9250-46a1-a25b-ea3fe8df2661 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:43:21 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-482e6ea3-9250-46a1-a25b-ea3fe8df2661 Jun 02 00:43:21 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:43:22 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Jun 02 00:43:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-482e6ea3-9250-46a1-a25b-ea3fe8df2661" returned: 0 in 0.697s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:43:22 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] Lock "cinder-quobyte-482e6ea3-9250-46a1-a25b-ea3fe8df2661" released by "delete_volume" :: held 1.660s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:43:22 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] Created reservations ['12134933-67a9-403b-8440-9580ab0380b2', 'ed26ac10-7a26-415d-9bf6-50cf21cdaae8', 'aefea491-cec3-434f-a39d-1e53808a5146', 'a07ad396-8862-472c-9f85-216a17c5d1ab'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:43:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:43:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:43:22 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:43:22 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:43:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:43:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:43:22 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:43:22 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:43:23 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Jun 02 00:43:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.905s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:43:23 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:43:23 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] Deleted volume successfully. Jun 02 00:43:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a6f776e4-b40c-4e8d-9d8f-ec6ba8b9a378 tempest-VolumeQuotasNegativeTestJSON-153304099 None] Lock "cinder-482e6ea3-9250-46a1-a25b-ea3fe8df2661-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:43:32 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=10 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:43:33 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=12,cinder:SELECT=8,cinder:DELETE=2,cinder:INSERT=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Flow 'volume_create_manager' (182828af-7d7d-4c05-a034-1cfbd0c3a756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d6cbce-bd11-42f2-b075-512aa9088c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d6cbce-bd11-42f2-b075-512aa9088c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-983640204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398e9146-79c2-4705-95c3-50a39bbd1676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6afe1238f5bb4f51ae8c851b7b5e3c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:43:35Z,use_quota=True,user_id='165b590fb11a4f28bc6db1d89b3f430e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eaed3cf0-76ae-414b-9c8d-ca21bbcd98b9),volume_type_id=eaed3cf0-76ae-414b-9c8d-ca21bbcd98b9)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc46256-7f48-4cdb-b940-e589af1bccd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc46256-7f48-4cdb-b940-e589af1bccd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf56747-cbd0-4bec-9192-6dc7d41ef423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf56747-cbd0-4bec-9192-6dc7d41ef423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '398e9146-79c2-4705-95c3-50a39bbd1676', 'volume_name': 'volume-398e9146-79c2-4705-95c3-50a39bbd1676', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60536406-2c5e-4428-a6b9-4c862c743697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60536406-2c5e-4428-a6b9-4c862c743697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f581960-52ed-4407-ac89-b1676735d728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:43:35 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Volume 398e9146-79c2-4705-95c3-50a39bbd1676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-398e9146-79c2-4705-95c3-50a39bbd1676', 'volume_size': 1} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-983640204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398e9146-79c2-4705-95c3-50a39bbd1676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6afe1238f5bb4f51ae8c851b7b5e3c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:43:35Z,use_quota=True,user_id='165b590fb11a4f28bc6db1d89b3f430e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eaed3cf0-76ae-414b-9c8d-ca21bbcd98b9),volume_type_id=eaed3cf0-76ae-414b-9c8d-ca21bbcd98b9)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Creating volume 398e9146-79c2-4705-95c3-50a39bbd1676 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:43:35 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:43:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-398e9146-79c2-4705-95c3-50a39bbd1676 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:43:35 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-398e9146-79c2-4705-95c3-50a39bbd1676 1073741824 Jun 02 00:43:35 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:43:36 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Jun 02 00:43:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-398e9146-79c2-4705-95c3-50a39bbd1676 1073741824" returned: 0 in 0.953s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:43:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-398e9146-79c2-4705-95c3-50a39bbd1676 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:43:36 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-398e9146-79c2-4705-95c3-50a39bbd1676 Jun 02 00:43:36 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:43:37 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Jun 02 00:43:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-398e9146-79c2-4705-95c3-50a39bbd1676" returned: 0 in 0.825s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:43:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:43:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:43:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f581960-52ed-4407-ac89-b1676735d728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-398e9146-79c2-4705-95c3-50a39bbd1676', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:43:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4994f14b-9fc4-4cda-b9b2-ca23315d201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:43:37 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Volume volume-398e9146-79c2-4705-95c3-50a39bbd1676 (398e9146-79c2-4705-95c3-50a39bbd1676): created successfully Jun 02 00:43:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4994f14b-9fc4-4cda-b9b2-ca23315d201b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:43:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Flow 'volume_create_manager' (182828af-7d7d-4c05-a034-1cfbd0c3a756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:43:37 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-4082275d-c238-43f7-9b8c-aefa718b3f74 tempest-VolumeTypesAccessTest-2095251549 None] Created volume successfully. Jun 02 00:43:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Acquiring lock "cinder-398e9146-79c2-4705-95c3-50a39bbd1676-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:43:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Lock "cinder-398e9146-79c2-4705-95c3-50a39bbd1676-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:43:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Acquiring lock "cinder-quobyte-398e9146-79c2-4705-95c3-50a39bbd1676" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:43:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Lock "cinder-quobyte-398e9146-79c2-4705-95c3-50a39bbd1676" acquired by "delete_volume" :: waited 0.030s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:43:37 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[596448b5-affb-41e1-bf7b-c20e2c4f1caf]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:43:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-398e9146-79c2-4705-95c3-50a39bbd1676 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:43:37 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-398e9146-79c2-4705-95c3-50a39bbd1676 Jun 02 00:43:37 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:43:39 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Jun 02 00:43:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-398e9146-79c2-4705-95c3-50a39bbd1676" returned: 0 in 1.563s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:43:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-398e9146-79c2-4705-95c3-50a39bbd1676 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:43:39 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-398e9146-79c2-4705-95c3-50a39bbd1676 Jun 02 00:43:39 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:43:40 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jun 02 00:43:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-398e9146-79c2-4705-95c3-50a39bbd1676" returned: 0 in 0.906s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:43:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Lock "cinder-quobyte-398e9146-79c2-4705-95c3-50a39bbd1676" released by "delete_volume" :: held 2.537s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:43:40 devstack cinder-volume[86910]: WARNING cinder.quota [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-178135231 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-178135231, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:43:40 devstack cinder-volume[86910]: WARNING cinder.quota [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-178135231 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-178135231, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:43:40 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Created reservations ['53f29b71-ddca-4eb3-b90a-0514b33be7b1', 'c3acb853-4f6f-4380-97f7-610481201b5b', '374593f8-2e5c-4c31-b520-90e14a2635c2', '28ee3e5b-3daf-4a54-9b64-4e6cc451cf7c'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:43:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:43:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:43:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:43:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:43:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:43:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:43:40 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:43:40 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:43:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9a744d15-cd11-48ea-b2e5-a9b4b26b6053 tempest-VolumesActionsTest-1574590668 None] Acquiring lock "cinder-51ece41e-c9fc-4e72-9acf-49bb7def3db3" by "attach_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:43:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9a744d15-cd11-48ea-b2e5-a9b4b26b6053 tempest-VolumesActionsTest-1574590668 None] Lock "cinder-51ece41e-c9fc-4e72-9acf-49bb7def3db3" acquired by "attach_volume" :: waited 0.047s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:43:40 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-9a744d15-cd11-48ea-b2e5-a9b4b26b6053 tempest-VolumesActionsTest-1574590668 None] Attaching volume 51ece41e-c9fc-4e72-9acf-49bb7def3db3 to instance 019bc504-64fa-4da1-be33-48369cfd1c90 at mountpoint /dev/vdb on host None. Jun 02 00:43:40 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-9a744d15-cd11-48ea-b2e5-a9b4b26b6053 tempest-VolumesActionsTest-1574590668 None] Attach volume completed successfully. Jun 02 00:43:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9a744d15-cd11-48ea-b2e5-a9b4b26b6053 tempest-VolumesActionsTest-1574590668 None] Lock "cinder-51ece41e-c9fc-4e72-9acf-49bb7def3db3" released by "attach_volume" :: held 0.139s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:43:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d11b80d4-26be-402d-981a-8faa27bcb841 tempest-VolumesActionsTest-1574590668 None] Acquiring lock "cinder-51ece41e-c9fc-4e72-9acf-49bb7def3db3-detach_volume" by "detach_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:43:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d11b80d4-26be-402d-981a-8faa27bcb841 tempest-VolumesActionsTest-1574590668 None] Lock "cinder-51ece41e-c9fc-4e72-9acf-49bb7def3db3-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:43:41 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-d11b80d4-26be-402d-981a-8faa27bcb841 tempest-VolumesActionsTest-1574590668 None] Detaching volume 51ece41e-c9fc-4e72-9acf-49bb7def3db3 from instance 019bc504-64fa-4da1-be33-48369cfd1c90. Jun 02 00:43:41 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jun 02 00:43:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.519s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:43:41 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:43:41 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-d11b80d4-26be-402d-981a-8faa27bcb841 tempest-VolumesActionsTest-1574590668 None] Detach volume completed successfully. Jun 02 00:43:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d11b80d4-26be-402d-981a-8faa27bcb841 tempest-VolumesActionsTest-1574590668 None] Lock "cinder-51ece41e-c9fc-4e72-9acf-49bb7def3db3-detach_volume" released by "detach_volume" :: held 0.115s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:43:41 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Deleted volume successfully. Jun 02 00:43:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-ca1008bb-c25c-412b-8465-3b9c694a4e26 tempest-VolumeTypesAccessTest-2095251549 None] Lock "cinder-398e9146-79c2-4705-95c3-50a39bbd1676-delete_volume" released by "delete_volume" :: held 4.515s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:43:51 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=15,cinder:SELECT=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:43:51 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=15,cinder:UPDATE=13,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:43:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4259f41b-2f61-4d3f-90d0-2efd7b71ab19 tempest-VolumesActionsTest-1574590668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:43:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4259f41b-2f61-4d3f-90d0-2efd7b71ab19 tempest-VolumesActionsTest-1574590668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:43:53 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccd49f0-4928-4d54-af03-48710adaa561]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:43:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4259f41b-2f61-4d3f-90d0-2efd7b71ab19 tempest-VolumesActionsTest-1574590668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:43:53 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 Jun 02 00:43:53 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:43:54 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jun 02 00:43:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4259f41b-2f61-4d3f-90d0-2efd7b71ab19 tempest-VolumesActionsTest-1574590668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3" returned: 0 in 0.994s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:43:54 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9b5d65-18eb-40f3-972e-b45d670a4b5d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:43:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4259f41b-2f61-4d3f-90d0-2efd7b71ab19 tempest-VolumesActionsTest-1574590668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:43:54 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 Jun 02 00:43:54 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:43:55 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Jun 02 00:43:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4259f41b-2f61-4d3f-90d0-2efd7b71ab19 tempest-VolumesActionsTest-1574590668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3" returned: 0 in 0.798s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:43:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4259f41b-2f61-4d3f-90d0-2efd7b71ab19 tempest-VolumesActionsTest-1574590668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.bad6dc92-579d-41a8-badf-2313f5b6aa63mk4mkfw4.img {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:43:55 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.bad6dc92-579d-41a8-badf-2313f5b6aa63mk4mkfw4.img Jun 02 00:43:55 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:03 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4259f41b-2f61-4d3f-90d0-2efd7b71ab19 tempest-VolumesActionsTest-1574590668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.bad6dc92-579d-41a8-badf-2313f5b6aa63mk4mkfw4.img" returned: 0 in 8.217s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:03 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8676a89c-6105-4945-b381-c988a6a10ab9]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:44:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4259f41b-2f61-4d3f-90d0-2efd7b71ab19 tempest-VolumesActionsTest-1574590668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:03 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 Jun 02 00:44:03 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:04 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:44:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Flow 'volume_create_manager' (9d801587-a38e-40ce-afc6-da15a198ff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:44:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ecc6cf-bafb-42bc-a3d6-83a014d62846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ecc6cf-bafb-42bc-a3d6-83a014d62846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-479204956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66841348-230e-4da9-a8fc-07472db95460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c9da674c8a4b06ae1f4b0db2a55378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:44:04Z,use_quota=True,user_id='4428f1db87b24e7dbb5102d642360d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982311b1-c80b-42a6-9520-35b674663503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982311b1-c80b-42a6-9520-35b674663503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97be22f-8905-47ea-8f0e-b370422ffede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97be22f-8905-47ea-8f0e-b370422ffede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66841348-230e-4da9-a8fc-07472db95460', 'volume_name': 'volume-66841348-230e-4da9-a8fc-07472db95460', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9a4bc2-78b8-4a9f-8430-197003258ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9a4bc2-78b8-4a9f-8430-197003258ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1be6ff-6fec-4de4-9694-0b0c2f356442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:04 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Volume 66841348-230e-4da9-a8fc-07472db95460: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66841348-230e-4da9-a8fc-07472db95460', 'volume_size': 1} Jun 02 00:44:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:04 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4259f41b-2f61-4d3f-90d0-2efd7b71ab19 tempest-VolumesActionsTest-1574590668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3" returned: 0 in 1.125s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:04 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-4259f41b-2f61-4d3f-90d0-2efd7b71ab19 tempest-VolumesActionsTest-1574590668 None] Image conversion details: src /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3, size 1024.00 MB, duration 8.22 sec, destination /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.bad6dc92-579d-41a8-badf-2313f5b6aa63mk4mkfw4.img {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:44:04 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-4259f41b-2f61-4d3f-90d0-2efd7b71ab19 tempest-VolumesActionsTest-1574590668 None] Converted 1024.00 MB image at 124.60 MB/s Jun 02 00:44:04 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-4259f41b-2f61-4d3f-90d0-2efd7b71ab19 tempest-VolumesActionsTest-1574590668 None] bad6dc92-579d-41a8-badf-2313f5b6aa63 was raw, no need to convert to raw {{(pid=86910) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Jun 02 00:44:07 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:44:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Flow 'volume_create_manager' (8fdd79cd-54f1-4bef-866b-a1fdffb88441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:44:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee313f79-fcda-43be-ab19-7da242ee6b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee313f79-fcda-43be-ab19-7da242ee6b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1118412649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba3af7a-8493-483f-9c61-e2c411fbbc41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5212a942cab4e01b9c819a7ed9d48fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:44:07Z,use_quota=True,user_id='113573ab634045fbb8e40936b51ab274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2597fcd8-de02-48bd-8ac0-79faed285080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2597fcd8-de02-48bd-8ac0-79faed285080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518c7e88-ab65-460a-b2a6-d7a2b8f92dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518c7e88-ab65-460a-b2a6-d7a2b8f92dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ba3af7a-8493-483f-9c61-e2c411fbbc41', 'volume_name': 'volume-8ba3af7a-8493-483f-9c61-e2c411fbbc41', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86f97c1-3e4d-4a26-bd8f-222dafa92cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86f97c1-3e4d-4a26-bd8f-222dafa92cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9473796-8890-4843-9287-adb4d4a2d908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:07 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Volume 8ba3af7a-8493-483f-9c61-e2c411fbbc41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ba3af7a-8493-483f-9c61-e2c411fbbc41', 'volume_size': 1} Jun 02 00:44:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:11 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:44:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Flow 'volume_create_manager' (6039c429-1715-40a0-85fb-51769c7ac60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:44:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac5b72a-8a03-400a-b4c6-514e6794efaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac5b72a-8a03-400a-b4c6-514e6794efaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-174136718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ad857d-3208-45b8-b422-8f2247cd10bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee89a980e9a34c8a868290134dfc302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:44:11Z,use_quota=True,user_id='5663cb7c571544988b2a9821b2d79c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48e02bb-6c4e-4e6e-b831-e7409e8d5bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48e02bb-6c4e-4e6e-b831-e7409e8d5bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035a0fc6-33f1-4640-a4dd-c89deb669b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035a0fc6-33f1-4640-a4dd-c89deb669b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5ad857d-3208-45b8-b422-8f2247cd10bf', 'volume_name': 'volume-b5ad857d-3208-45b8-b422-8f2247cd10bf', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1b3895-31f3-4b42-8d24-5e0d0a5fddda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1b3895-31f3-4b42-8d24-5e0d0a5fddda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a8ec81-83a2-4dbe-8a58-e58921d6639e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:11 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Volume b5ad857d-3208-45b8-b422-8f2247cd10bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5ad857d-3208-45b8-b422-8f2247cd10bf', 'volume_size': 1} Jun 02 00:44:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:21 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:44:21 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:44:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4259f41b-2f61-4d3f-90d0-2efd7b71ab19 tempest-VolumesActionsTest-1574590668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.298s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4259f41b-2f61-4d3f-90d0-2efd7b71ab19 tempest-VolumesActionsTest-1574590668 None] Uploaded volume to glance image-id: bad6dc92-579d-41a8-badf-2313f5b6aa63. {{(pid=86910) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 02 00:44:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.344s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-479204956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66841348-230e-4da9-a8fc-07472db95460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c9da674c8a4b06ae1f4b0db2a55378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:44:04Z,use_quota=True,user_id='4428f1db87b24e7dbb5102d642360d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:44:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Creating volume 66841348-230e-4da9-a8fc-07472db95460 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:44:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:44:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:44:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:44:25 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:44:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-66841348-230e-4da9-a8fc-07472db95460 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:25 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-66841348-230e-4da9-a8fc-07472db95460 1073741824 Jun 02 00:44:25 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:25 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-4259f41b-2f61-4d3f-90d0-2efd7b71ab19 tempest-VolumesActionsTest-1574590668 None] Copy volume to image completed successfully. Jun 02 00:44:26 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-66841348-230e-4da9-a8fc-07472db95460 1073741824" returned: 0 in 0.805s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-66841348-230e-4da9-a8fc-07472db95460 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:26 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-66841348-230e-4da9-a8fc-07472db95460 Jun 02 00:44:26 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:27 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-66841348-230e-4da9-a8fc-07472db95460" returned: 0 in 0.596s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.846s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1118412649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba3af7a-8493-483f-9c61-e2c411fbbc41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5212a942cab4e01b9c819a7ed9d48fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:44:07Z,use_quota=True,user_id='113573ab634045fbb8e40936b51ab274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Creating volume 8ba3af7a-8493-483f-9c61-e2c411fbbc41 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:44:27 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8ba3af7a-8493-483f-9c61-e2c411fbbc41 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1be6ff-6fec-4de4-9694-0b0c2f356442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66841348-230e-4da9-a8fc-07472db95460', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:27 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8ba3af7a-8493-483f-9c61-e2c411fbbc41 1073741824 Jun 02 00:44:27 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94259575-5df5-4e94-9f42-fdb22eb57d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:27 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Volume volume-66841348-230e-4da9-a8fc-07472db95460 (66841348-230e-4da9-a8fc-07472db95460): created successfully Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94259575-5df5-4e94-9f42-fdb22eb57d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Flow 'volume_create_manager' (9d801587-a38e-40ce-afc6-da15a198ff94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:44:27 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-308bf21f-3248-423e-a8d7-a3bf1630dc51 tempest-TestMinimumBasicScenario-121747074 None] Created volume successfully. Jun 02 00:44:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:28 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8ba3af7a-8493-483f-9c61-e2c411fbbc41 1073741824" returned: 0 in 0.813s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8ba3af7a-8493-483f-9c61-e2c411fbbc41 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:28 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8ba3af7a-8493-483f-9c61-e2c411fbbc41 Jun 02 00:44:28 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:28 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8ba3af7a-8493-483f-9c61-e2c411fbbc41" returned: 0 in 0.601s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.454s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-174136718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ad857d-3208-45b8-b422-8f2247cd10bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee89a980e9a34c8a868290134dfc302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:44:11Z,use_quota=True,user_id='5663cb7c571544988b2a9821b2d79c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Creating volume b5ad857d-3208-45b8-b422-8f2247cd10bf {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:44:28 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b5ad857d-3208-45b8-b422-8f2247cd10bf 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9473796-8890-4843-9287-adb4d4a2d908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ba3af7a-8493-483f-9c61-e2c411fbbc41', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:28 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b5ad857d-3208-45b8-b422-8f2247cd10bf 1073741824 Jun 02 00:44:28 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7232361f-a0d4-4c37-bdcf-0ff2b889fc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:28 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Volume volume-8ba3af7a-8493-483f-9c61-e2c411fbbc41 (8ba3af7a-8493-483f-9c61-e2c411fbbc41): created successfully Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7232361f-a0d4-4c37-bdcf-0ff2b889fc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Flow 'volume_create_manager' (8fdd79cd-54f1-4bef-866b-a1fdffb88441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:44:28 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f71b9ac7-6573-4d19-8dcb-bd9bf1bc533b tempest-VolumesTransfersV355Test-1292720190 None] Created volume successfully. Jun 02 00:44:29 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b5ad857d-3208-45b8-b422-8f2247cd10bf 1073741824" returned: 0 in 0.751s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b5ad857d-3208-45b8-b422-8f2247cd10bf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:29 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b5ad857d-3208-45b8-b422-8f2247cd10bf Jun 02 00:44:29 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:30 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b5ad857d-3208-45b8-b422-8f2247cd10bf" returned: 0 in 0.596s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:44:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.667s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a8ec81-83a2-4dbe-8a58-e58921d6639e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5ad857d-3208-45b8-b422-8f2247cd10bf', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8475bc4e-e306-40bf-acbc-6c33e6e8a0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:30 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eefa807-ecb0-411d-a6f8-32cb5dea892b]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:44:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:30 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Volume volume-b5ad857d-3208-45b8-b422-8f2247cd10bf (b5ad857d-3208-45b8-b422-8f2247cd10bf): created successfully Jun 02 00:44:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8475bc4e-e306-40bf-acbc-6c33e6e8a0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Flow 'volume_create_manager' (6039c429-1715-40a0-85fb-51769c7ac60a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:44:30 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-5e176749-da1d-4080-984b-207c6dd86f34 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Created volume successfully. Jun 02 00:44:30 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 Jun 02 00:44:30 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:30 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f8cbea51-4c1a-4801-b90f-6cd96c49016e tempest-VolumesTransfersV355Test-452780139 None] Transfer volume completed successfully. Jun 02 00:44:30 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3" returned: 0 in 0.759s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:30 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[18597e06-d28e-4d4a-8da6-396a1f9f8397]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:44:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:30 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 Jun 02 00:44:30 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-23bf1c28-7cbc-4c13-9002-21ef0d34bc49 req-e24f4fe9-4780-4311-aec4-a61cc89f0370 tempest-TestMinimumBasicScenario-121747074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] Acquiring lock "cinder-8ba3af7a-8493-483f-9c61-e2c411fbbc41-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:44:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] Lock "cinder-8ba3af7a-8493-483f-9c61-e2c411fbbc41-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:44:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] Acquiring lock "cinder-quobyte-8ba3af7a-8493-483f-9c61-e2c411fbbc41" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:44:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] Lock "cinder-quobyte-8ba3af7a-8493-483f-9c61-e2c411fbbc41" acquired by "delete_volume" :: waited 0.014s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:44:31 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e52addd-861d-4d2a-aa8e-cc6f06d6bf5f]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:44:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8ba3af7a-8493-483f-9c61-e2c411fbbc41 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:31 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8ba3af7a-8493-483f-9c61-e2c411fbbc41 Jun 02 00:44:31 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:31 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3" returned: 0 in 0.809s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.f8755fb6-649a-44d6-baf4-c95999e0dd4ai5l58err.img {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:31 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.f8755fb6-649a-44d6-baf4-c95999e0dd4ai5l58err.img Jun 02 00:44:31 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:32 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8ba3af7a-8493-483f-9c61-e2c411fbbc41" returned: 0 in 0.702s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8ba3af7a-8493-483f-9c61-e2c411fbbc41 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:32 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8ba3af7a-8493-483f-9c61-e2c411fbbc41 Jun 02 00:44:32 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:32 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8ba3af7a-8493-483f-9c61-e2c411fbbc41" returned: 0 in 0.905s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:33 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] Lock "cinder-quobyte-8ba3af7a-8493-483f-9c61-e2c411fbbc41" released by "delete_volume" :: held 1.706s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:44:33 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] Created reservations ['57a05b47-e6a4-4270-8dc2-92f64dd0fe52', 'b5d1d2b5-5af5-437a-b630-52d6593d2652', '451e6813-0d5d-4f5d-987d-44cb7dcb158a', 'a0a0e775-779a-47d0-aff8-a06cd203d4d0'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:44:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:44:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:44:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:33 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:44:33 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:34 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.295s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:34 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:44:34 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] Deleted volume successfully. Jun 02 00:44:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7fc7cf4b-b7fc-46b5-bc83-225af271c027 tempest-VolumesTransfersV355Test-552407706 None] Lock "cinder-8ba3af7a-8493-483f-9c61-e2c411fbbc41-delete_volume" released by "delete_volume" :: held 3.482s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:44:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-4c1b053c-afe9-4a2b-b9a2-3643432bc624 req-a9e736c5-0b79-413f-b81a-bd3a72fa3863 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:34 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:44:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Flow 'volume_create_manager' (cd7e191f-d900-4f8a-8ea7-32aab890f705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:44:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04aa121e-1bac-49c7-b16e-d575fdf22910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04aa121e-1bac-49c7-b16e-d575fdf22910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-672821329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769e2d0a-4a64-41f9-a487-cd95fd33a590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5212a942cab4e01b9c819a7ed9d48fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:44:35Z,use_quota=True,user_id='113573ab634045fbb8e40936b51ab274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ec0c34-e7b8-4370-affc-24e5960f2adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ec0c34-e7b8-4370-affc-24e5960f2adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00de32b2-2940-439d-8cae-366d405925b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00de32b2-2940-439d-8cae-366d405925b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '769e2d0a-4a64-41f9-a487-cd95fd33a590', 'volume_name': 'volume-769e2d0a-4a64-41f9-a487-cd95fd33a590', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f455b5f5-ebbb-4f61-91f7-79d53f6939f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f455b5f5-ebbb-4f61-91f7-79d53f6939f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:34 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e329b75-3856-4520-b8f8-18cbfc433970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:34 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Volume 769e2d0a-4a64-41f9-a487-cd95fd33a590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-769e2d0a-4a64-41f9-a487-cd95fd33a590', 'volume_size': 1} Jun 02 00:44:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:36 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.f8755fb6-649a-44d6-baf4-c95999e0dd4ai5l58err.img" returned: 0 in 4.916s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:36 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f8bdfd-7bd3-4d34-92bf-eda6c6d2b8b0]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:44:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:36 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 Jun 02 00:44:36 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:37 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3" returned: 0 in 0.852s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:37 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] Image conversion details: src /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3, size 1024.00 MB, duration 4.92 sec, destination /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.f8755fb6-649a-44d6-baf4-c95999e0dd4ai5l58err.img {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:44:37 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] Converted 1024.00 MB image at 208.24 MB/s Jun 02 00:44:37 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] f8755fb6-649a-44d6-baf4-c95999e0dd4a was raw, converting to qcow2 {{(pid=86910) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Jun 02 00:44:37 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66dad5e-219a-49c1-9346-8902d25002d4]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:44:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.f8755fb6-649a-44d6-baf4-c95999e0dd4ai5l58err.img {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:37 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.f8755fb6-649a-44d6-baf4-c95999e0dd4ai5l58err.img Jun 02 00:44:37 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:38 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.f8755fb6-649a-44d6-baf4-c95999e0dd4ai5l58err.img" returned: 0 in 0.659s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.f8755fb6-649a-44d6-baf4-c95999e0dd4ai5l58err.img {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:38 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.f8755fb6-649a-44d6-baf4-c95999e0dd4ai5l58err.img Jun 02 00:44:38 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:38 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.f8755fb6-649a-44d6-baf4-c95999e0dd4ai5l58err.img" returned: 1 in 0.660s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.f8755fb6-649a-44d6-baf4-c95999e0dd4ai5l58err.img' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:44:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.f8755fb6-649a-44d6-baf4-c95999e0dd4ai5l58err.img /opt/stack/data/cinder/conversion/vol_upload_7wz3essh {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:38 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.f8755fb6-649a-44d6-baf4-c95999e0dd4ai5l58err.img /opt/stack/data/cinder/conversion/vol_upload_7wz3essh Jun 02 00:44:38 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:39 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.f8755fb6-649a-44d6-baf4-c95999e0dd4ai5l58err.img /opt/stack/data/cinder/conversion/vol_upload_7wz3essh" returned: 0 in 0.777s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:39 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] Image conversion details: src /opt/stack/data/cinder/conversion/51ece41e-c9fc-4e72-9acf-49bb7def3db3.temp_image.f8755fb6-649a-44d6-baf4-c95999e0dd4ai5l58err.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_7wz3essh {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:44:39 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 02 00:44:39 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ae1ff5-97b9-45c0-a5f3-9664d58d5f69]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:44:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7wz3essh {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:39 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7wz3essh Jun 02 00:44:39 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:40 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7wz3essh" returned: 0 in 0.717s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.443s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:41 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] Uploaded volume to glance image-id: f8755fb6-649a-44d6-baf4-c95999e0dd4a. {{(pid=86910) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 02 00:44:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-23bf1c28-7cbc-4c13-9002-21ef0d34bc49 req-e24f4fe9-4780-4311-aec4-a61cc89f0370 tempest-TestMinimumBasicScenario-121747074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.363s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:41 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a6af34-7598-42bd-88d4-30e8166822b4]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:44:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-23bf1c28-7cbc-4c13-9002-21ef0d34bc49 req-e24f4fe9-4780-4311-aec4-a61cc89f0370 tempest-TestMinimumBasicScenario-121747074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-66841348-230e-4da9-a8fc-07472db95460 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:41 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-6343c585-7aa5-4464-9d64-4df08ae85f63 tempest-VolumesActionsTest-1574590668 None] Copy volume to image completed successfully. Jun 02 00:44:41 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-66841348-230e-4da9-a8fc-07472db95460 Jun 02 00:44:41 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:42 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-23bf1c28-7cbc-4c13-9002-21ef0d34bc49 req-e24f4fe9-4780-4311-aec4-a61cc89f0370 tempest-TestMinimumBasicScenario-121747074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-66841348-230e-4da9-a8fc-07472db95460" returned: 0 in 0.690s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-23bf1c28-7cbc-4c13-9002-21ef0d34bc49 req-e24f4fe9-4780-4311-aec4-a61cc89f0370 tempest-TestMinimumBasicScenario-121747074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.716s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-4c1b053c-afe9-4a2b-b9a2-3643432bc624 req-a9e736c5-0b79-413f-b81a-bd3a72fa3863 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.492s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:42 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[64acfa20-df65-4d62-b779-7d5c604687a7]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:44:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-4c1b053c-afe9-4a2b-b9a2-3643432bc624 req-a9e736c5-0b79-413f-b81a-bd3a72fa3863 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b5ad857d-3208-45b8-b422-8f2247cd10bf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:42 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-23bf1c28-7cbc-4c13-9002-21ef0d34bc49 req-e24f4fe9-4780-4311-aec4-a61cc89f0370 tempest-TestMinimumBasicScenario-121747074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-66841348-230e-4da9-a8fc-07472db95460', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef66aa59-208c-4579-afca-e29aaaf139fc', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:44:42 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-23bf1c28-7cbc-4c13-9002-21ef0d34bc49 req-e24f4fe9-4780-4311-aec4-a61cc89f0370 tempest-TestMinimumBasicScenario-121747074 None] attachment_update completed successfully. Jun 02 00:44:42 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b5ad857d-3208-45b8-b422-8f2247cd10bf Jun 02 00:44:42 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:43 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-4c1b053c-afe9-4a2b-b9a2-3643432bc624 req-a9e736c5-0b79-413f-b81a-bd3a72fa3863 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b5ad857d-3208-45b8-b422-8f2247cd10bf" returned: 0 in 0.807s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-4c1b053c-afe9-4a2b-b9a2-3643432bc624 req-a9e736c5-0b79-413f-b81a-bd3a72fa3863 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.827s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.185s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-672821329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769e2d0a-4a64-41f9-a487-cd95fd33a590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5212a942cab4e01b9c819a7ed9d48fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:44:35Z,use_quota=True,user_id='113573ab634045fbb8e40936b51ab274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Creating volume 769e2d0a-4a64-41f9-a487-cd95fd33a590 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:44:43 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-769e2d0a-4a64-41f9-a487-cd95fd33a590 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:43 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-769e2d0a-4a64-41f9-a487-cd95fd33a590 1073741824 Jun 02 00:44:43 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-4c1b053c-afe9-4a2b-b9a2-3643432bc624 req-a9e736c5-0b79-413f-b81a-bd3a72fa3863 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-b5ad857d-3208-45b8-b422-8f2247cd10bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'acbdddb5-8db5-42c1-927e-d9ef5d5face0', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:44:43 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-4c1b053c-afe9-4a2b-b9a2-3643432bc624 req-a9e736c5-0b79-413f-b81a-bd3a72fa3863 tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] attachment_update completed successfully. Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] Acquiring lock "cinder-51ece41e-c9fc-4e72-9acf-49bb7def3db3-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] Lock "cinder-51ece41e-c9fc-4e72-9acf-49bb7def3db3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] Acquiring lock "cinder-quobyte-51ece41e-c9fc-4e72-9acf-49bb7def3db3" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] Lock "cinder-quobyte-51ece41e-c9fc-4e72-9acf-49bb7def3db3" acquired by "delete_volume" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ded8afb-e4d6-44c3-ad9b-aa305e9a2408]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:43 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 Jun 02 00:44:43 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:43 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-769e2d0a-4a64-41f9-a487-cd95fd33a590 1073741824" returned: 0 in 0.887s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-769e2d0a-4a64-41f9-a487-cd95fd33a590 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:44 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-769e2d0a-4a64-41f9-a487-cd95fd33a590 Jun 02 00:44:44 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:44 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-769e2d0a-4a64-41f9-a487-cd95fd33a590" returned: 0 in 0.605s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:44:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:44 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3" returned: 0 in 0.820s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e329b75-3856-4520-b8f8-18cbfc433970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-769e2d0a-4a64-41f9-a487-cd95fd33a590', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94eb092f-7b1d-4513-beab-e81a716cc109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:44 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3 Jun 02 00:44:44 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:44 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Volume volume-769e2d0a-4a64-41f9-a487-cd95fd33a590 (769e2d0a-4a64-41f9-a487-cd95fd33a590): created successfully Jun 02 00:44:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94eb092f-7b1d-4513-beab-e81a716cc109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Flow 'volume_create_manager' (cd7e191f-d900-4f8a-8ea7-32aab890f705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:44:44 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-b2cc2414-2106-4b16-bd4a-64c2f6cbf14e tempest-VolumesTransfersV355Test-1292720190 None] Created volume successfully. Jun 02 00:44:45 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-51ece41e-c9fc-4e72-9acf-49bb7def3db3" returned: 0 in 0.581s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] Lock "cinder-quobyte-51ece41e-c9fc-4e72-9acf-49bb7def3db3" released by "delete_volume" :: held 1.462s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:44:45 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] Created reservations ['65fbc0cf-f998-43d4-abe5-61c26aa7aced', '9f79368c-1ced-4042-93a4-397bd71fa33d', 'b02f095d-9ca9-4bbb-974e-6af49fc169cf', '52b4f09c-d7aa-4809-82d9-dd04f5d0e3aa'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:44:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:44:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:44:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:45 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:44:45 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] Acquiring lock "cinder-769e2d0a-4a64-41f9-a487-cd95fd33a590-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:44:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] Lock "cinder-769e2d0a-4a64-41f9-a487-cd95fd33a590-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:44:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] Acquiring lock "cinder-quobyte-769e2d0a-4a64-41f9-a487-cd95fd33a590" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:44:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] Lock "cinder-quobyte-769e2d0a-4a64-41f9-a487-cd95fd33a590" acquired by "delete_volume" :: waited 0.016s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:44:45 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f8fc9c-b5cc-449f-a13d-1306dcdfa15a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:44:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-769e2d0a-4a64-41f9-a487-cd95fd33a590 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:45 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-769e2d0a-4a64-41f9-a487-cd95fd33a590 Jun 02 00:44:45 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:45 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.621s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:45 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:44:45 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] Deleted volume successfully. Jun 02 00:44:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c68550b9-0b8b-43a4-ae77-96b9e28e1fdd tempest-VolumesActionsTest-1574590668 None] Lock "cinder-51ece41e-c9fc-4e72-9acf-49bb7def3db3-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:44:46 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-769e2d0a-4a64-41f9-a487-cd95fd33a590" returned: 0 in 0.780s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-769e2d0a-4a64-41f9-a487-cd95fd33a590 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:46 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-769e2d0a-4a64-41f9-a487-cd95fd33a590 Jun 02 00:44:46 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:46 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-769e2d0a-4a64-41f9-a487-cd95fd33a590" returned: 0 in 0.646s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] Lock "cinder-quobyte-769e2d0a-4a64-41f9-a487-cd95fd33a590" released by "delete_volume" :: held 1.473s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:44:47 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] Created reservations ['f2630384-aaf1-44fd-a909-eff152085a0e', '0dd359b6-de62-41d6-9a7f-b5c4a8b5ddee', 'ed397d5f-444d-4bb5-9467-ec842d52ad23', '6b7dd700-7a91-40d6-85db-b6d3ebf2bc47'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:44:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:44:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:44:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:47 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:44:47 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:47 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.731s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:47 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:44:47 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] Deleted volume successfully. Jun 02 00:44:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e0f3f4e-30aa-49bf-9d41-bb4f590d3b2a tempest-VolumesTransfersV355Test-552407706 None] Lock "cinder-769e2d0a-4a64-41f9-a487-cd95fd33a590-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:44:51 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-0d7a4125-b8a6-4d22-8ce7-0d30e7b0d99a req-e2f1e879-1ff5-40a4-8aae-9d366ab7a94c tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Terminate volume connection completed successfully. Jun 02 00:44:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-0d7a4125-b8a6-4d22-8ce7-0d30e7b0d99a req-e2f1e879-1ff5-40a4-8aae-9d366ab7a94c tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Deleting attachment acbdddb5-8db5-42c1-927e-d9ef5d5face0. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:44:53 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Acquiring lock "cinder-b5ad857d-3208-45b8-b422-8f2247cd10bf-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:44:53 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Lock "cinder-b5ad857d-3208-45b8-b422-8f2247cd10bf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:44:53 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Acquiring lock "cinder-quobyte-b5ad857d-3208-45b8-b422-8f2247cd10bf" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:44:53 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Lock "cinder-quobyte-b5ad857d-3208-45b8-b422-8f2247cd10bf" acquired by "delete_volume" :: waited 0.038s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:44:53 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6530306-7cee-4b85-874d-dcdd587eb98c]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:44:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b5ad857d-3208-45b8-b422-8f2247cd10bf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:53 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b5ad857d-3208-45b8-b422-8f2247cd10bf Jun 02 00:44:53 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:54 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b5ad857d-3208-45b8-b422-8f2247cd10bf" returned: 0 in 0.858s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b5ad857d-3208-45b8-b422-8f2247cd10bf {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:54 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b5ad857d-3208-45b8-b422-8f2247cd10bf Jun 02 00:44:54 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:55 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b5ad857d-3208-45b8-b422-8f2247cd10bf" returned: 0 in 0.878s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Lock "cinder-quobyte-b5ad857d-3208-45b8-b422-8f2247cd10bf" released by "delete_volume" :: held 1.825s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Created reservations ['843c85ce-23b5-4e15-a135-945ace325564', 'c51a2fe0-fddf-442d-b024-fd8d2034d64b', '7827d433-30d1-49fe-be19-c12ad33a0d8e', '4b663715-f4f6-447f-acb6-1cae37de6a68'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:55 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:44:55 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Flow 'volume_create_manager' (cda5ac79-fa38-4c41-bfa7-071af77edf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9236ee43-6d81-4d25-ac82-dc3998c7ac0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9236ee43-6d81-4d25-ac82-dc3998c7ac0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1490395472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190289e7-83d1-4571-a6b1-0f0174b276f0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9b7c4dc1569e419aa640495b60c3d4f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:44:56Z,use_quota=True,user_id='343d926a0dae43dd81be9d2482069cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1cffe2-c0a5-4e6d-aad9-43319669c2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1cffe2-c0a5-4e6d-aad9-43319669c2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2930c15f-aebe-4c1d-acfa-2c0013b7e1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2930c15f-aebe-4c1d-acfa-2c0013b7e1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '190289e7-83d1-4571-a6b1-0f0174b276f0', 'volume_name': 'volume-190289e7-83d1-4571-a6b1-0f0174b276f0', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a68337-274e-4955-8d3c-80da709803d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a68337-274e-4955-8d3c-80da709803d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c1eec7-a390-4209-94f1-4fcf7729ada6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:55 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Volume 190289e7-83d1-4571-a6b1-0f0174b276f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-190289e7-83d1-4571-a6b1-0f0174b276f0', 'volume_size': 1} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1490395472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190289e7-83d1-4571-a6b1-0f0174b276f0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9b7c4dc1569e419aa640495b60c3d4f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:44:56Z,use_quota=True,user_id='343d926a0dae43dd81be9d2482069cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Creating volume 190289e7-83d1-4571-a6b1-0f0174b276f0 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:44:55 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:44:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-190289e7-83d1-4571-a6b1-0f0174b276f0 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:55 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-190289e7-83d1-4571-a6b1-0f0174b276f0 1073741824 Jun 02 00:44:55 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:56 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.954s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:56 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:44:56 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Deleted volume successfully. Jun 02 00:44:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-588e253f-07bd-4d2b-888e-493399bf62db tempest-TestServerVolumeAttachScenarioOldVersion-1361495372 None] Lock "cinder-b5ad857d-3208-45b8-b422-8f2247cd10bf-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:44:56 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-190289e7-83d1-4571-a6b1-0f0174b276f0 1073741824" returned: 0 in 1.027s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-190289e7-83d1-4571-a6b1-0f0174b276f0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:56 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-190289e7-83d1-4571-a6b1-0f0174b276f0 Jun 02 00:44:56 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:44:57 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jun 02 00:44:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-190289e7-83d1-4571-a6b1-0f0174b276f0" returned: 0 in 0.912s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:44:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:44:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c1eec7-a390-4209-94f1-4fcf7729ada6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-190289e7-83d1-4571-a6b1-0f0174b276f0', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463482f2-ea84-4968-8d74-fb1aa304b6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:57 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Volume volume-190289e7-83d1-4571-a6b1-0f0174b276f0 (190289e7-83d1-4571-a6b1-0f0174b276f0): created successfully Jun 02 00:44:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463482f2-ea84-4968-8d74-fb1aa304b6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Flow 'volume_create_manager' (cda5ac79-fa38-4c41-bfa7-071af77edf21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:44:57 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-68959665-27f9-4dfc-8fc3-5cb6f692b962 tempest-VolumesGetTest-1454169299 None] Created volume successfully. Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Flow 'volume_create_manager' (daac39fd-37c6-40fe-b6de-b5c7a813fe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd1c693-3f68-4709-8e1a-7bbf5544e08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd1c693-3f68-4709-8e1a-7bbf5544e08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:44:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1734960586',display_name='tempest-VolumesGetTest-Volume-322509433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eaa997b-eb36-40ec-a039-635047883703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7c4dc1569e419aa640495b60c3d4f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:00Z,use_quota=True,user_id='343d926a0dae43dd81be9d2482069cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3c7f2a-aadf-43a7-b6c4-a54ecb7f9ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3c7f2a-aadf-43a7-b6c4-a54ecb7f9ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cceecf0-3265-45ea-a0e9-c31f09a2c11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cceecf0-3265-45ea-a0e9-c31f09a2c11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eaa997b-eb36-40ec-a039-635047883703', 'volume_name': 'volume-7eaa997b-eb36-40ec-a039-635047883703', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff9f2b2-ddd9-4d3f-9d77-d38ef9054d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff9f2b2-ddd9-4d3f-9d77-d38ef9054d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91803aaa-056d-4195-839c-9bcdbff7abb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:44:59 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Volume 7eaa997b-eb36-40ec-a039-635047883703: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eaa997b-eb36-40ec-a039-635047883703', 'volume_size': 1} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:44:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1734960586',display_name='tempest-VolumesGetTest-Volume-322509433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eaa997b-eb36-40ec-a039-635047883703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7c4dc1569e419aa640495b60c3d4f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:00Z,use_quota=True,user_id='343d926a0dae43dd81be9d2482069cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Creating volume 7eaa997b-eb36-40ec-a039-635047883703 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:44:59 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:44:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7eaa997b-eb36-40ec-a039-635047883703 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:44:59 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7eaa997b-eb36-40ec-a039-635047883703 1073741824 Jun 02 00:44:59 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:00 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7eaa997b-eb36-40ec-a039-635047883703 1073741824" returned: 0 in 1.030s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7eaa997b-eb36-40ec-a039-635047883703 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:00 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7eaa997b-eb36-40ec-a039-635047883703 Jun 02 00:45:00 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:01 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7eaa997b-eb36-40ec-a039-635047883703" returned: 0 in 0.643s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:45:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91803aaa-056d-4195-839c-9bcdbff7abb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eaa997b-eb36-40ec-a039-635047883703', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc025143-eac8-437c-a5df-9ad7c2bd721a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:01 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Volume volume-7eaa997b-eb36-40ec-a039-635047883703 (7eaa997b-eb36-40ec-a039-635047883703): created successfully Jun 02 00:45:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc025143-eac8-437c-a5df-9ad7c2bd721a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Flow 'volume_create_manager' (daac39fd-37c6-40fe-b6de-b5c7a813fe61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:45:01 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ab05a950-697b-428f-8853-a8277b540be6 tempest-VolumesGetTest-1454169299 None] Created volume successfully. Jun 02 00:45:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] Acquiring lock "cinder-7eaa997b-eb36-40ec-a039-635047883703-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] Lock "cinder-7eaa997b-eb36-40ec-a039-635047883703-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] Acquiring lock "cinder-quobyte-7eaa997b-eb36-40ec-a039-635047883703" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-7eaa997b-eb36-40ec-a039-635047883703" acquired by "delete_volume" :: waited 0.022s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:02 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[24602456-decd-4ed3-9b86-2cf752b2181e]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7eaa997b-eb36-40ec-a039-635047883703 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:02 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7eaa997b-eb36-40ec-a039-635047883703 Jun 02 00:45:02 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:03 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7eaa997b-eb36-40ec-a039-635047883703" returned: 0 in 1.212s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7eaa997b-eb36-40ec-a039-635047883703 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:03 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7eaa997b-eb36-40ec-a039-635047883703 Jun 02 00:45:03 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:04 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7eaa997b-eb36-40ec-a039-635047883703" returned: 0 in 0.953s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-7eaa997b-eb36-40ec-a039-635047883703" released by "delete_volume" :: held 2.249s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:45:04 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] Created reservations ['fc92b2ec-802c-4639-95bf-6532dbfb76a7', '4e86122f-2441-4bf2-9b8f-1fe83e8f459f', '4d4d9b72-bab9-40df-a492-f5189bcdf510', 'cf4be8d8-a8f2-4ba2-be6f-079ce40e8ab6'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:45:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:45:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:45:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:04 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:45:04 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] Acquiring lock "cinder-190289e7-83d1-4571-a6b1-0f0174b276f0-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] Lock "cinder-190289e7-83d1-4571-a6b1-0f0174b276f0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] Acquiring lock "cinder-quobyte-190289e7-83d1-4571-a6b1-0f0174b276f0" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:05 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.232s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:05 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:45:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-190289e7-83d1-4571-a6b1-0f0174b276f0" acquired by "delete_volume" :: waited 0.050s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:05 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] Deleted volume successfully. Jun 02 00:45:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-742d2705-0987-4322-b82f-e6536c4f9353 tempest-VolumesGetTest-1454169299 None] Lock "cinder-7eaa997b-eb36-40ec-a039-635047883703-delete_volume" released by "delete_volume" :: held 3.893s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:45:05 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e0f22a-389a-4bb6-804d-f7200d01cabb]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-190289e7-83d1-4571-a6b1-0f0174b276f0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:06 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-190289e7-83d1-4571-a6b1-0f0174b276f0 Jun 02 00:45:06 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:07 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-190289e7-83d1-4571-a6b1-0f0174b276f0" returned: 0 in 1.188s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-190289e7-83d1-4571-a6b1-0f0174b276f0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:07 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-190289e7-83d1-4571-a6b1-0f0174b276f0 Jun 02 00:45:07 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:08 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-190289e7-83d1-4571-a6b1-0f0174b276f0" returned: 0 in 0.938s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-190289e7-83d1-4571-a6b1-0f0174b276f0" released by "delete_volume" :: held 2.254s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:45:08 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] Created reservations ['1219c0ab-b6a3-4a99-a438-38e7f3508de8', '1db6c921-a06e-4446-b6fa-8f8002ad327b', '01f60713-499f-4552-9bba-6582100131fb', '389c69fc-9b57-4421-96a3-f5add1aae732'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:45:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:45:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:45:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:08 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:45:08 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:09 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.880s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:09 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:45:09 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] Deleted volume successfully. Jun 02 00:45:09 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-99537e0f-1009-4096-9ed2-ba32ff4c3925 tempest-VolumesGetTest-1454169299 None] Lock "cinder-190289e7-83d1-4571-a6b1-0f0174b276f0-delete_volume" released by "delete_volume" :: held 3.582s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Flow 'volume_create_manager' (da092ade-fa89-4530-a365-e0c5b68e20be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b06964c-f975-497d-9b15-ccb63449dc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b06964c-f975-497d-9b15-ccb63449dc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1459092308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a323288c-526f-49c0-81b0-29716074a3a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7c4dc1569e419aa640495b60c3d4f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:10Z,use_quota=True,user_id='343d926a0dae43dd81be9d2482069cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7556b62-f5d2-4bd5-8be6-3814d64da0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7556b62-f5d2-4bd5-8be6-3814d64da0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06316652-74dc-430c-b1d2-efe14fec7355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06316652-74dc-430c-b1d2-efe14fec7355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a323288c-526f-49c0-81b0-29716074a3a5', 'volume_name': 'volume-a323288c-526f-49c0-81b0-29716074a3a5', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27390231-a97d-418d-8621-e04148c17c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27390231-a97d-418d-8621-e04148c17c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e3dbcb-c748-4931-9118-9fe467498788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:10 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Volume a323288c-526f-49c0-81b0-29716074a3a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a323288c-526f-49c0-81b0-29716074a3a5', 'volume_size': 1} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1459092308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a323288c-526f-49c0-81b0-29716074a3a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7c4dc1569e419aa640495b60c3d4f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:10Z,use_quota=True,user_id='343d926a0dae43dd81be9d2482069cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Creating volume a323288c-526f-49c0-81b0-29716074a3a5 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:45:10 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:10 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 1073741824 Jun 02 00:45:10 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Flow 'volume_create_manager' (41c04ba1-cb2a-4209-9c49-23f991ed8859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2693c360-3d5e-432e-a1e4-7a93f0235d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2693c360-3d5e-432e-a1e4-7a93f0235d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1098294837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f77849ef-960d-4eca-8378-d27b728e7af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30f685aa40545e1aeacf7788f39a23f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:10Z,use_quota=True,user_id='ecb169ff4af64bd68f12962ffe2fec9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27575a4e-46ba-4c8f-9aff-883cdab590b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27575a4e-46ba-4c8f-9aff-883cdab590b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6743ab21-1570-44f5-9a11-819b564e5ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6743ab21-1570-44f5-9a11-819b564e5ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f77849ef-960d-4eca-8378-d27b728e7af5', 'volume_name': 'volume-f77849ef-960d-4eca-8378-d27b728e7af5', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160855a0-f9d5-4436-8d27-bc4e0f612932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160855a0-f9d5-4436-8d27-bc4e0f612932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c96d1b-57ba-499c-acd4-a7112f8ba575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:10 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Volume f77849ef-960d-4eca-8378-d27b728e7af5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f77849ef-960d-4eca-8378-d27b728e7af5', 'volume_size': 1} Jun 02 00:45:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:11 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 1073741824" returned: 0 in 1.068s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:11 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 Jun 02 00:45:11 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:12 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5" returned: 0 in 0.809s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:45:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.523s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1098294837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f77849ef-960d-4eca-8378-d27b728e7af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30f685aa40545e1aeacf7788f39a23f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:10Z,use_quota=True,user_id='ecb169ff4af64bd68f12962ffe2fec9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:45:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Creating volume f77849ef-960d-4eca-8378-d27b728e7af5 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:45:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:45:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:45:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:45:12 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:45:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e3dbcb-c748-4931-9118-9fe467498788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a323288c-526f-49c0-81b0-29716074a3a5', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:12 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5 1073741824 Jun 02 00:45:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91cf6a3-8262-4b21-b36e-6d1bf84dfceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:12 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:12 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Volume volume-a323288c-526f-49c0-81b0-29716074a3a5 (a323288c-526f-49c0-81b0-29716074a3a5): created successfully Jun 02 00:45:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91cf6a3-8262-4b21-b36e-6d1bf84dfceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Flow 'volume_create_manager' (da092ade-fa89-4530-a365-e0c5b68e20be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:45:12 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-b1302bf0-3912-4a9d-b7f2-3e981fad8e19 tempest-VolumesGetTest-1454169299 None] Created volume successfully. Jun 02 00:45:13 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5 1073741824" returned: 0 in 1.053s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:13 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5 Jun 02 00:45:13 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Flow 'volume_create_manager' (f2643f0b-b4ce-4fb0-8945-2f02b1eb8d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0206a61d-8366-4fb3-9023-6af0f68e082c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0206a61d-8366-4fb3-9023-6af0f68e082c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1118341501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a5a18d-2416-45d5-b1e6-3f0576fe61b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9b7c4dc1569e419aa640495b60c3d4f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a323288c-526f-49c0-81b0-29716074a3a5,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:14Z,use_quota=True,user_id='343d926a0dae43dd81be9d2482069cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cddeae-4e0c-4708-abca-cb257340d48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cddeae-4e0c-4708-abca-cb257340d48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222657e2-3aef-4084-9aba-494b0e3518b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222657e2-3aef-4084-9aba-494b0e3518b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd4a5a18d-2416-45d5-b1e6-3f0576fe61b1', 'volume_name': 'volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1', 'volume_size': 1, 'source_volid': 'a323288c-526f-49c0-81b0-29716074a3a5', 'source_volstatus': 'available'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6851ae-bfbf-4435-b53a-146664433e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6851ae-bfbf-4435-b53a-146664433e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5340b5-1783-42d2-905c-2a46fd5aec04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:14 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Volume d4a5a18d-2416-45d5-b1e6-3f0576fe61b1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1', 'volume_size': 1, 'source_volid': 'a323288c-526f-49c0-81b0-29716074a3a5', 'source_volstatus': 'available'} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:14 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5" returned: 0 in 0.998s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.109s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:14 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Cloning volume a323288c-526f-49c0-81b0-29716074a3a5 to volume d4a5a18d-2416-45d5-b1e6-3f0576fe61b1 Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c96d1b-57ba-499c-acd4-a7112f8ba575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f77849ef-960d-4eca-8378-d27b728e7af5', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9a29ca-bcd1-45ff-8cfc-fb5345d62790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:14 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Volume volume-f77849ef-960d-4eca-8378-d27b728e7af5 (f77849ef-960d-4eca-8378-d27b728e7af5): created successfully Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9a29ca-bcd1-45ff-8cfc-fb5345d62790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Flow 'volume_create_manager' (41c04ba1-cb2a-4209-9c49-23f991ed8859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Creating offline snapshot 80de59fb-3ca5-450a-8200-546f7bc7f41f of volume a323288c-526f-49c0-81b0-29716074a3a5 {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:45:14 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a0c85639-5474-4ca9-a67e-c75834940b7b tempest-VolumesSnapshotTestJSON-1559731239 None] Created volume successfully. Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[820447e8-95e5-4222-8ad0-290b1b9a4e11]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:14 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 Jun 02 00:45:14 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:45:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:45:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:45:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:15 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:45:15 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:15 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5" returned: 0 in 0.992s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:15 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f 1G Jun 02 00:45:15 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:15 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.734s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:15 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:45:16 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f 1G" returned: 0 in 1.038s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a323288c-526f-49c0-81b0-29716074a3a5 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:16 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a323288c-526f-49c0-81b0-29716074a3a5 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f Jun 02 00:45:16 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:17 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a323288c-526f-49c0-81b0-29716074a3a5 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f" returned: 0 in 0.808s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:17 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f is being set with open permissions: ugo+rw Jun 02 00:45:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:17 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f Jun 02 00:45:17 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:18 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f" returned: 0 in 0.751s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:18 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.info Jun 02 00:45:18 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:18 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.info" returned: 0 in 0.672s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:18 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.info is being set with open permissions: ugo+rw Jun 02 00:45:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:18 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.info Jun 02 00:45:18 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:19 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.info" returned: 0 in 0.620s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Acquiring lock "cinder-quobyte-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1" by "_copy_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] snapshot: 80de59fb-3ca5-450a-8200-546f7bc7f41f, volume: d4a5a18d-2416-45d5-b1e6-3f0576fe61b1, {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 00:45:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:45:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:45:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:19 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc07788-31ff-48b1-9476-c8f0ae3e717d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:19 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f Jun 02 00:45:19 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:20 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f" returned: 0 in 0.745s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:20 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a323288c-526f-49c0-81b0-29716074a3a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:45:20 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 00:45:20 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Creating direct copy from snapshot {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 00:45:20 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83cd18b-82a5-4f21-bcf9-57ad1919e94c]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:20 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 Jun 02 00:45:20 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:20 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5" returned: 0 in 0.765s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:20 devstack cinder-volume[86910]: DEBUG cinder.utils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Path /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1 not found in is_blk_device check {{(pid=86910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 00:45:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:20 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1 Jun 02 00:45:21 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:26 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1" returned: 0 in 5.723s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:26 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bf3d2e-3c10-4758-8d1d-20abbd2cae9c]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:26 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 Jun 02 00:45:26 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:27 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5" returned: 0 in 0.962s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:27 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Image conversion details: src /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1 {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:45:27 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Converted 1024.00 MB image at 178.87 MB/s Jun 02 00:45:27 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1 is being set with open permissions: ugo+rw Jun 02 00:45:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:27 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1 Jun 02 00:45:27 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:28 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=61,cinder:UPDATE=80,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:45:28 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=72,cinder:SELECT=64,cinder:DELETE=9,cinder:INSERT=15 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:45:28 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1" returned: 0 in 0.640s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1" released by "_copy_volume_from_snapshot" :: held 8.920s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:45:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Acquiring lock "cinder-quobyte-80de59fb-3ca5-450a-8200-546f7bc7f41f" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-80de59fb-3ca5-450a-8200-546f7bc7f41f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Deleting offline snapshot 80de59fb-3ca5-450a-8200-546f7bc7f41f of volume a323288c-526f-49c0-81b0-29716074a3a5 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:45:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] snapshot_file for this snap is: volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:45:28 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6dcc85-0c1a-480d-8175-56954df45b0c]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:28 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f Jun 02 00:45:28 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:29 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f" returned: 0 in 0.908s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:29 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a323288c-526f-49c0-81b0-29716074a3a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:45:29 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2da8389-7a0a-4032-b204-913695ca2c9d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:29 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 Jun 02 00:45:29 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:30 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5" returned: 0 in 0.844s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:30 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f Jun 02 00:45:30 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:31 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f" returned: 0 in 0.831s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:31 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f Jun 02 00:45:31 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:31 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5.80de59fb-3ca5-450a-8200-546f7bc7f41f" returned: 0 in 0.753s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-80de59fb-3ca5-450a-8200-546f7bc7f41f" released by "_delete_snapshot" :: held 3.464s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:45:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.502s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.457s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:31 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] Creating offline snapshot d42a85e5-b14c-4d74-b367-71b10a928c38 of volume f77849ef-960d-4eca-8378-d27b728e7af5 {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:45:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5340b5-1783-42d2-905c-2a46fd5aec04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1', 'volume_size': 1, 'source_volid': 'a323288c-526f-49c0-81b0-29716074a3a5', 'source_volstatus': 'available'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39bd16f0-b4bd-4ad6-ade3-8a87f6bd7140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:31 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7244d8d-5dc0-4e09-bba0-63ac515c7f84]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:31 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Volume volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1 (d4a5a18d-2416-45d5-b1e6-3f0576fe61b1): created successfully Jun 02 00:45:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39bd16f0-b4bd-4ad6-ade3-8a87f6bd7140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:31 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Flow 'volume_create_manager' (f2643f0b-b4ce-4fb0-8945-2f02b1eb8d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:45:31 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-7a02c9ed-81f0-472e-a274-7f9d8504d3f4 tempest-VolumesGetTest-1454169299 None] Created volume successfully. Jun 02 00:45:32 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5 Jun 02 00:45:32 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:32 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5" returned: 0 in 0.969s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:32 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38 1G Jun 02 00:45:32 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:33 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:45:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Flow 'volume_create_manager' (e94aeca5-3d3e-4823-b579-7de55e934d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:45:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092833c5-ee93-41f9-a145-4e2f8d4f25d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092833c5-ee93-41f9-a145-4e2f8d4f25d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:45:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1800566053',display_name='tempest-VolumesGetTest-Volume-1089799074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80302ccf-51a2-4a57-a1d5-bab53b8bc89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7c4dc1569e419aa640495b60c3d4f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:33Z,use_quota=True,user_id='343d926a0dae43dd81be9d2482069cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebab9e7-7cdb-4e51-ae26-ef4dc2fdc912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebab9e7-7cdb-4e51-ae26-ef4dc2fdc912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c52d8b-c9cc-4068-af5e-020cb167526e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c52d8b-c9cc-4068-af5e-020cb167526e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80302ccf-51a2-4a57-a1d5-bab53b8bc89c', 'volume_name': 'volume-80302ccf-51a2-4a57-a1d5-bab53b8bc89c', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349989c8-34e8-497f-a643-685ce41d0ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349989c8-34e8-497f-a643-685ce41d0ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:33 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49aef912-585e-45bc-8128-a55100d27be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:33 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Volume 80302ccf-51a2-4a57-a1d5-bab53b8bc89c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80302ccf-51a2-4a57-a1d5-bab53b8bc89c', 'volume_size': 1} Jun 02 00:45:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:34 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38 1G" returned: 0 in 1.161s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f77849ef-960d-4eca-8378-d27b728e7af5 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:34 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f77849ef-960d-4eca-8378-d27b728e7af5 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38 Jun 02 00:45:34 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:34 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f77849ef-960d-4eca-8378-d27b728e7af5 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38" returned: 0 in 0.677s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:34 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38 is being set with open permissions: ugo+rw Jun 02 00:45:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:34 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38 Jun 02 00:45:34 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:35 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-150745e1-8bfc-4760-93ed-4656186503c4 req-29150019-5d0c-4953-ba22-65f3ebb4ff37 tempest-TestMinimumBasicScenario-121747074 None] Terminate volume connection completed successfully. Jun 02 00:45:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-150745e1-8bfc-4760-93ed-4656186503c4 req-29150019-5d0c-4953-ba22-65f3ebb4ff37 tempest-TestMinimumBasicScenario-121747074 None] Deleting attachment ef66aa59-208c-4579-afca-e29aaaf139fc. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:45:35 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38" returned: 0 in 0.672s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:35 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.info Jun 02 00:45:35 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:36 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.info" returned: 0 in 0.662s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:36 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.info is being set with open permissions: ugo+rw Jun 02 00:45:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:36 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.info Jun 02 00:45:36 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:36 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.info" returned: 0 in 0.603s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.862s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.302s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:36 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:45:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1800566053',display_name='tempest-VolumesGetTest-Volume-1089799074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80302ccf-51a2-4a57-a1d5-bab53b8bc89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7c4dc1569e419aa640495b60c3d4f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:33Z,use_quota=True,user_id='343d926a0dae43dd81be9d2482069cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:45:36 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Creating volume 80302ccf-51a2-4a57-a1d5-bab53b8bc89c {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:45:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:36 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:45:36 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:45:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:36 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:45:36 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:45:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-80302ccf-51a2-4a57-a1d5-bab53b8bc89c 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:36 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-80302ccf-51a2-4a57-a1d5-bab53b8bc89c 1073741824 Jun 02 00:45:36 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:36 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f3a3198e-e9a7-425f-8339-3f70ee8ad915 tempest-VolumesSnapshotTestJSON-1559731239 None] Create snapshot completed successfully Jun 02 00:45:37 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-80302ccf-51a2-4a57-a1d5-bab53b8bc89c 1073741824" returned: 0 in 1.036s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-80302ccf-51a2-4a57-a1d5-bab53b8bc89c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:37 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-80302ccf-51a2-4a57-a1d5-bab53b8bc89c Jun 02 00:45:37 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] Acquiring lock "cinder-66841348-230e-4da9-a8fc-07472db95460-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] Lock "cinder-66841348-230e-4da9-a8fc-07472db95460-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] Acquiring lock "cinder-quobyte-66841348-230e-4da9-a8fc-07472db95460" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] Lock "cinder-quobyte-66841348-230e-4da9-a8fc-07472db95460" acquired by "delete_volume" :: waited 0.045s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-d42a85e5-b14c-4d74-b367-71b10a928c38-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a31572-3264-4380-92e7-568d8b7cbace]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-66841348-230e-4da9-a8fc-07472db95460 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-d42a85e5-b14c-4d74-b367-71b10a928c38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-quobyte-f77849ef-960d-4eca-8378-d27b728e7af5" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-f77849ef-960d-4eca-8378-d27b728e7af5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-quobyte-d42a85e5-b14c-4d74-b367-71b10a928c38" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-d42a85e5-b14c-4d74-b367-71b10a928c38" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] Deleting offline snapshot d42a85e5-b14c-4d74-b367-71b10a928c38 of volume f77849ef-960d-4eca-8378-d27b728e7af5 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] snapshot_file for this snap is: volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac25a750-7292-4fa5-b564-384844fa21cc]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:38 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-66841348-230e-4da9-a8fc-07472db95460 Jun 02 00:45:38 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:38 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38 Jun 02 00:45:38 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:38 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-80302ccf-51a2-4a57-a1d5-bab53b8bc89c" returned: 0 in 0.758s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49aef912-585e-45bc-8128-a55100d27be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80302ccf-51a2-4a57-a1d5-bab53b8bc89c', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305371b9-5eb4-4aba-9d91-9436aa1ab387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:38 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Volume volume-80302ccf-51a2-4a57-a1d5-bab53b8bc89c (80302ccf-51a2-4a57-a1d5-bab53b8bc89c): created successfully Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305371b9-5eb4-4aba-9d91-9436aa1ab387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Flow 'volume_create_manager' (e94aeca5-3d3e-4823-b579-7de55e934d3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:45:38 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-dcc736d4-3358-4cae-908b-06917a8ad6f6 tempest-VolumesGetTest-1454169299 None] Created volume successfully. Jun 02 00:45:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] Acquiring lock "cinder-80302ccf-51a2-4a57-a1d5-bab53b8bc89c-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] Lock "cinder-80302ccf-51a2-4a57-a1d5-bab53b8bc89c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] Acquiring lock "cinder-quobyte-80302ccf-51a2-4a57-a1d5-bab53b8bc89c" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-80302ccf-51a2-4a57-a1d5-bab53b8bc89c" acquired by "delete_volume" :: waited 0.038s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:39 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b4ae11-2975-47dc-890d-a427309d9182]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-80302ccf-51a2-4a57-a1d5-bab53b8bc89c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:39 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-66841348-230e-4da9-a8fc-07472db95460" returned: 0 in 1.140s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-66841348-230e-4da9-a8fc-07472db95460 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:39 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-66841348-230e-4da9-a8fc-07472db95460 Jun 02 00:45:39 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:39 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-80302ccf-51a2-4a57-a1d5-bab53b8bc89c Jun 02 00:45:39 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:39 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38" returned: 0 in 1.295s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:39 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f77849ef-960d-4eca-8378-d27b728e7af5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:45:39 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64fc092-d182-4662-9ef9-1c5772c184b1]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:39 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5 Jun 02 00:45:39 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:40 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-66841348-230e-4da9-a8fc-07472db95460" returned: 0 in 1.001s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] Lock "cinder-quobyte-66841348-230e-4da9-a8fc-07472db95460" released by "delete_volume" :: held 2.253s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:45:40 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] Created reservations ['10c56e7e-8d19-4114-bb95-58d03def18dc', 'c2eafbb5-a1eb-4a98-8aed-22c51a86fd64', 'd4bf200f-84b9-452b-8b4d-ca220296e364', '1751e3c4-07db-4760-93f2-24ea11fef1ae'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:45:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:45:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:45:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:40 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:45:40 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:40 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-80302ccf-51a2-4a57-a1d5-bab53b8bc89c" returned: 0 in 1.380s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-80302ccf-51a2-4a57-a1d5-bab53b8bc89c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:40 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-80302ccf-51a2-4a57-a1d5-bab53b8bc89c Jun 02 00:45:40 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:40 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5" returned: 0 in 1.017s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:40 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38 Jun 02 00:45:40 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:41 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.712s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:41 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:45:41 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] Deleted volume successfully. Jun 02 00:45:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-8dd9a5a2-f1f8-489d-bbdf-ee5e1f30ea53 tempest-TestMinimumBasicScenario-121747074 None] Lock "cinder-66841348-230e-4da9-a8fc-07472db95460-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:45:41 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-80302ccf-51a2-4a57-a1d5-bab53b8bc89c" returned: 0 in 1.113s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:41 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-80302ccf-51a2-4a57-a1d5-bab53b8bc89c" released by "delete_volume" :: held 2.576s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:45:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38" returned: 0 in 1.109s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:41 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38 Jun 02 00:45:41 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:41 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] Created reservations ['295d386d-a0ec-4f30-b19c-0bcedce6e136', 'e94ee2e6-8ac8-4480-8a83-38ab833be93b', '37775289-abc5-43e5-b27e-65d26c971830', 'cfcdd3e5-e6a1-4991-9efb-766cb11be140'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:45:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:41 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:45:41 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:45:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:42 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:45:42 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] Acquiring lock "cinder-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] Lock "cinder-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] Acquiring lock "cinder-quobyte-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:42 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5.d42a85e5-b14c-4d74-b367-71b10a928c38" returned: 0 in 0.817s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1" acquired by "delete_volume" :: waited 0.046s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:42 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c059055-e16a-4bb0-8439-4c114f793a31]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-d42a85e5-b14c-4d74-b367-71b10a928c38" released by "_delete_snapshot" :: held 4.544s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:45:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-f77849ef-960d-4eca-8378-d27b728e7af5" released by "delete_snapshot" :: held 4.604s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:45:42 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1 Jun 02 00:45:42 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:42 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] Created reservations ['7675149f-c6c5-4539-8c45-951567fed425', '5c53fcc9-d254-4c7d-8fd3-bf1acb65d8b8', 'f07c807b-dccd-4dcd-8955-144ae5d0fd69', '99bad1ec-e9df-46d9-8f86-aaa3bf8ccc57'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:45:42 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.021s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:45:43 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] Deleted volume successfully. Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7d620e48-d5c0-42a1-8776-c60faeda00ff tempest-VolumesGetTest-1454169299 None] Lock "cinder-80302ccf-51a2-4a57-a1d5-bab53b8bc89c-delete_volume" released by "delete_volume" :: held 4.039s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:45:43 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] Delete snapshot completed successfully. Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4ceeef22-bb4b-4930-aa83-6f4441397713 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-d42a85e5-b14c-4d74-b367-71b10a928c38-delete_snapshot" released by "delete_snapshot" :: held 4.941s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Flow 'volume_create_manager' (95dbcd03-3798-4397-a45d-6503c399b23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d0849c-9902-4495-a54c-b68e210fd329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d0849c-9902-4495-a54c-b68e210fd329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-132306936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc7c04f-cd2a-484b-b251-32553978a89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a38b1c36a5946c490343ac150f99315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:43Z,use_quota=True,user_id='abe5c886732b447bb9ebd7ed8117a8f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e285fd76-8cac-438b-853c-1d5e5580a660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e285fd76-8cac-438b-853c-1d5e5580a660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30ca27f-ca02-4212-81d4-b9e6d3ce0fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30ca27f-ca02-4212-81d4-b9e6d3ce0fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdc7c04f-cd2a-484b-b251-32553978a89b', 'volume_name': 'volume-bdc7c04f-cd2a-484b-b251-32553978a89b', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592f5d47-a677-4df8-aa5e-de6a70f6c94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592f5d47-a677-4df8-aa5e-de6a70f6c94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d92954-42f0-4a42-be8f-06ad99830b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:43 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Volume bdc7c04f-cd2a-484b-b251-32553978a89b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdc7c04f-cd2a-484b-b251-32553978a89b', 'volume_size': 1} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-132306936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc7c04f-cd2a-484b-b251-32553978a89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a38b1c36a5946c490343ac150f99315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:43Z,use_quota=True,user_id='abe5c886732b447bb9ebd7ed8117a8f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Creating volume bdc7c04f-cd2a-484b-b251-32553978a89b {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:45:43 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bdc7c04f-cd2a-484b-b251-32553978a89b 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:43 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bdc7c04f-cd2a-484b-b251-32553978a89b 1073741824 Jun 02 00:45:43 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:43 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1" returned: 0 in 0.925s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:43 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1 Jun 02 00:45:43 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Flow 'volume_create_manager' (afdbd413-e88d-4ba4-9629-4b5fe40488fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7290322-b21e-47c7-83a6-6266cb32f87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7290322-b21e-47c7-83a6-6266cb32f87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1417029280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572cbde4-dd7a-4b1e-9370-1940be12b705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a38b1c36a5946c490343ac150f99315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:44Z,use_quota=True,user_id='abe5c886732b447bb9ebd7ed8117a8f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8380cad0-cf8c-45a0-b4a6-06d351916ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8380cad0-cf8c-45a0-b4a6-06d351916ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858a28f2-bbce-4ee8-83e4-fac3cd1ab224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858a28f2-bbce-4ee8-83e4-fac3cd1ab224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '572cbde4-dd7a-4b1e-9370-1940be12b705', 'volume_name': 'volume-572cbde4-dd7a-4b1e-9370-1940be12b705', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f491e40a-b107-40fc-b092-169ac8a39e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f491e40a-b107-40fc-b092-169ac8a39e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e5f49d-ca3e-4e03-8665-19607d88e592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:43 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Volume 572cbde4-dd7a-4b1e-9370-1940be12b705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-572cbde4-dd7a-4b1e-9370-1940be12b705', 'volume_size': 1} Jun 02 00:45:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Flow 'volume_create_manager' (cee36629-53d4-4384-b908-5d415944bda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9723fb38-6f1c-463f-b1f8-a1a8f247a6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9723fb38-6f1c-463f-b1f8-a1a8f247a6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-353842957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0798aa30-2820-4b4c-aeba-478626ddb524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30f685aa40545e1aeacf7788f39a23f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:44Z,use_quota=True,user_id='ecb169ff4af64bd68f12962ffe2fec9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e1210d-2028-4208-aea5-2b55689eb981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e1210d-2028-4208-aea5-2b55689eb981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3640bba5-8105-46ef-b944-6a67c7e10cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3640bba5-8105-46ef-b944-6a67c7e10cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0798aa30-2820-4b4c-aeba-478626ddb524', 'volume_name': 'volume-0798aa30-2820-4b4c-aeba-478626ddb524', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6494dcd2-b559-4ca5-aba4-62ea4acc0a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6494dcd2-b559-4ca5-aba4-62ea4acc0a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a0bb6d-c159-4e2c-8a76-a32a5d008a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:44 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Volume 0798aa30-2820-4b4c-aeba-478626ddb524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0798aa30-2820-4b4c-aeba-478626ddb524', 'volume_size': 1} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:44 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1" returned: 0 in 0.843s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1" released by "delete_volume" :: held 1.936s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] Created reservations ['38634d9a-fea5-4b17-a3ce-b7defb27cb2b', '361fe665-3be8-4ff7-aa43-11252cc72543', '8dbbd579-3011-41e9-9f8a-442b85cdca32', '4b3aafe6-661d-4bb9-95d9-77e0322bf06d'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:45:44 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bdc7c04f-cd2a-484b-b251-32553978a89b 1073741824" returned: 0 in 1.383s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bdc7c04f-cd2a-484b-b251-32553978a89b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:44 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:45:44 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bdc7c04f-cd2a-484b-b251-32553978a89b Jun 02 00:45:44 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:44 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] Acquiring lock "cinder-a323288c-526f-49c0-81b0-29716074a3a5-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] Lock "cinder-a323288c-526f-49c0-81b0-29716074a3a5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] Acquiring lock "cinder-quobyte-a323288c-526f-49c0-81b0-29716074a3a5" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-a323288c-526f-49c0-81b0-29716074a3a5" acquired by "delete_volume" :: waited 0.034s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed93c6f-1e07-4a39-87a1-a0d47a86a7dd]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:45 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 Jun 02 00:45:45 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:45 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.866s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:45:45 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:45 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] Deleted volume successfully. Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bdc7c04f-cd2a-484b-b251-32553978a89b" returned: 0 in 0.871s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] <== create_volume: return (2333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.695s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1417029280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572cbde4-dd7a-4b1e-9370-1940be12b705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a38b1c36a5946c490343ac150f99315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:44Z,use_quota=True,user_id='abe5c886732b447bb9ebd7ed8117a8f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Creating volume 572cbde4-dd7a-4b1e-9370-1940be12b705 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:45:45 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-572cbde4-dd7a-4b1e-9370-1940be12b705 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2f3e05c1-f22e-4fba-8a2a-d304ed1e120e tempest-VolumesGetTest-1454169299 None] Lock "cinder-d4a5a18d-2416-45d5-b1e6-3f0576fe61b1-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d92954-42f0-4a42-be8f-06ad99830b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdc7c04f-cd2a-484b-b251-32553978a89b', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:45 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-572cbde4-dd7a-4b1e-9370-1940be12b705 1073741824 Jun 02 00:45:45 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca937f4-9183-4a20-a866-76c6f1f0ace1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:45 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Volume volume-bdc7c04f-cd2a-484b-b251-32553978a89b (bdc7c04f-cd2a-484b-b251-32553978a89b): created successfully Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca937f4-9183-4a20-a866-76c6f1f0ace1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Flow 'volume_create_manager' (95dbcd03-3798-4397-a45d-6503c399b23a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:45:45 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-202d1d8d-3c42-4d1e-a79c-8dd35711bbf1 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Created volume successfully. Jun 02 00:45:45 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5" returned: 0 in 0.844s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:46 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5 Jun 02 00:45:46 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:46 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-572cbde4-dd7a-4b1e-9370-1940be12b705 1073741824" returned: 0 in 0.910s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-572cbde4-dd7a-4b1e-9370-1940be12b705 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:46 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-572cbde4-dd7a-4b1e-9370-1940be12b705 Jun 02 00:45:46 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:46 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a323288c-526f-49c0-81b0-29716074a3a5" returned: 0 in 0.724s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-a323288c-526f-49c0-81b0-29716074a3a5" released by "delete_volume" :: held 1.659s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:45:46 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] Created reservations ['d8869c69-104c-4c20-ab19-eabd14ddb3ef', '333aff56-4c29-442e-9719-798cb9e0ea6d', 'f1b18fd9-707a-407c-bf16-780af3316e51', '2eae2f67-2517-43c6-be23-346e718fd2e0'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:45:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:45:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:45:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:46 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:45:46 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:47 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-572cbde4-dd7a-4b1e-9370-1940be12b705" returned: 0 in 0.653s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.848s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-353842957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0798aa30-2820-4b4c-aeba-478626ddb524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30f685aa40545e1aeacf7788f39a23f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:44Z,use_quota=True,user_id='ecb169ff4af64bd68f12962ffe2fec9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Creating volume 0798aa30-2820-4b4c-aeba-478626ddb524 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:45:47 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:47 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 1073741824 Jun 02 00:45:47 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e5f49d-ca3e-4e03-8665-19607d88e592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-572cbde4-dd7a-4b1e-9370-1940be12b705', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6e1996-b8e2-445c-8653-46b12dad91de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:47 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Volume volume-572cbde4-dd7a-4b1e-9370-1940be12b705 (572cbde4-dd7a-4b1e-9370-1940be12b705): created successfully Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6e1996-b8e2-445c-8653-46b12dad91de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Flow 'volume_create_manager' (afdbd413-e88d-4ba4-9629-4b5fe40488fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:45:47 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-30ede704-eb65-4688-b01a-65a90b15d6d7 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Created volume successfully. Jun 02 00:45:47 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.912s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:45:47 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] Deleted volume successfully. Jun 02 00:45:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cd5b6f2b-7970-492f-a0e1-deb49e696007 tempest-VolumesGetTest-1454169299 None] Lock "cinder-a323288c-526f-49c0-81b0-29716074a3a5-delete_volume" released by "delete_volume" :: held 2.873s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:45:48 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:45:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Flow 'volume_create_manager' (dd502850-d3fb-4046-80cc-3f7ef3d87722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:45:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8831d46-be12-4929-8418-4ddcbf861e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8831d46-be12-4929-8418-4ddcbf861e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2144430085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efe4913-1a8a-4d92-b023-89da24cc648f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9b7c4dc1569e419aa640495b60c3d4f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:48Z,use_quota=True,user_id='343d926a0dae43dd81be9d2482069cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac651d8-c19c-495f-a858-4e169e433ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac651d8-c19c-495f-a858-4e169e433ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68600c4-3fef-464b-83aa-1c43dee2e510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:48 devstack cinder-volume[86910]: DEBUG cinder.image.glance [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Creating Keystone auth plugin from conf {{(pid=86910) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 00:45:48 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 1073741824" returned: 0 in 1.089s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:48 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 Jun 02 00:45:48 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68600c4-3fef-464b-83aa-1c43dee2e510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4efe4913-1a8a-4d92-b023-89da24cc648f', 'volume_name': 'volume-4efe4913-1a8a-4d92-b023-89da24cc648f', 'volume_size': 1, 'image_id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '213591b260fd4db58e9aae1daeaec391', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'created_at': datetime.datetime(2026, 6, 1, 22, 25, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 25, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b93abc4-d162-4478-b919-a527963e0e4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394af1b5-eee7-493b-bce9-e759afbfb177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394af1b5-eee7-493b-bce9-e759afbfb177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05c9b8c-44af-4d88-9d48-1f7fa1962a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:48 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Volume 4efe4913-1a8a-4d92-b023-89da24cc648f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4efe4913-1a8a-4d92-b023-89da24cc648f', 'volume_size': 1, 'image_id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '213591b260fd4db58e9aae1daeaec391', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'created_at': datetime.datetime(2026, 6, 1, 22, 25, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 25, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b93abc4-d162-4478-b919-a527963e0e4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 02 00:45:48 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Trying to clone 4efe4913-1a8a-4d92-b023-89da24cc648f from image 1b93abc4-d162-4478-b919-a527963e0e4e at location (None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}]). {{(pid=86910) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 00:45:49 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524" returned: 0 in 0.801s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:45:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:49 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_uc9xtff9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 00:45:49 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Image download 20.69 MB at 20.69 MB/s Jun 02 00:45:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a0bb6d-c159-4e2c-8a76-a32a5d008a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0798aa30-2820-4b4c-aeba-478626ddb524', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6517b01b-8e40-4eb2-b11b-c5ad53f5d63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:49 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Volume volume-0798aa30-2820-4b4c-aeba-478626ddb524 (0798aa30-2820-4b4c-aeba-478626ddb524): created successfully Jun 02 00:45:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6517b01b-8e40-4eb2-b11b-c5ad53f5d63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Flow 'volume_create_manager' (cee36629-53d4-4384-b908-5d415944bda4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:45:49 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[432f7415-623f-4007-b77f-f1df130bc1cb]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_uc9xtff9devstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:49 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-26923943-a1f2-48a0-8381-057a3c5881c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Created volume successfully. Jun 02 00:45:49 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_uc9xtff9devstack@QuobyteHD Jun 02 00:45:49 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] Creating offline snapshot 3e5ae26b-15d7-4563-8230-00c8857f9f7d of volume 0798aa30-2820-4b4c-aeba-478626ddb524 {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:45:50 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[01311fdb-2a42-42b4-b118-40a20ecec401]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:50 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_uc9xtff9devstack@QuobyteHD" returned: 0 in 0.869s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:50 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Temporary image 1b93abc4-d162-4478-b919-a527963e0e4e is fetched for user 343d926a0dae43dd81be9d2482069cfe. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 00:45:50 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 Jun 02 00:45:50 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:50 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f963706-a6a8-4d99-8464-75af5a35b7ad]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_uc9xtff9devstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:50 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_uc9xtff9devstack@QuobyteHD Jun 02 00:45:50 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:50 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524" returned: 0 in 0.793s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:50 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d 1G Jun 02 00:45:50 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:51 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_uc9xtff9devstack@QuobyteHD" returned: 0 in 0.762s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:51 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d 1G" returned: 0 in 0.791s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0798aa30-2820-4b4c-aeba-478626ddb524 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:51 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0798aa30-2820-4b4c-aeba-478626ddb524 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d Jun 02 00:45:51 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:52 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0798aa30-2820-4b4c-aeba-478626ddb524 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d" returned: 0 in 0.691s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:52 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d is being set with open permissions: ugo+rw Jun 02 00:45:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:52 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d Jun 02 00:45:52 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:53 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d" returned: 0 in 0.651s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:53 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.info Jun 02 00:45:53 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:53 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.info" returned: 0 in 0.786s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:53 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.info is being set with open permissions: ugo+rw Jun 02 00:45:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:53 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.info Jun 02 00:45:53 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:54 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.info" returned: 0 in 0.774s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.601s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.615s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2144430085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efe4913-1a8a-4d92-b023-89da24cc648f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9b7c4dc1569e419aa640495b60c3d4f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:48Z,use_quota=True,user_id='343d926a0dae43dd81be9d2482069cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:45:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Creating volume 4efe4913-1a8a-4d92-b023-89da24cc648f {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:45:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:45:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:45:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:45:54 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:45:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:54 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f 1073741824 Jun 02 00:45:54 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:54 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-897cef65-b586-42c9-b131-e3078f1f2c86 tempest-VolumesSnapshotTestJSON-1559731239 None] Create snapshot completed successfully Jun 02 00:45:55 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f 1073741824" returned: 0 in 0.900s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:55 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f Jun 02 00:45:55 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:55 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:45:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Flow 'volume_create_manager' (0bb5252c-70dc-4f98-9a4a-b509248e8683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:45:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b6b6a2-9980-49bd-8e3f-b74a0cfa5e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b6b6a2-9980-49bd-8e3f-b74a0cfa5e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2017470494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57c0fba-1e3f-4361-ace8-b62af3cf89c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30f685aa40545e1aeacf7788f39a23f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:45:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3e5ae26b-15d7-4563-8230-00c8857f9f7d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:45:56Z,use_quota=True,user_id='ecb169ff4af64bd68f12962ffe2fec9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841534e1-20e1-4ec5-9db3-50c8c1919e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841534e1-20e1-4ec5-9db3-50c8c1919e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0c1872-7521-4bcc-b53a-5e8d11dcdfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0c1872-7521-4bcc-b53a-5e8d11dcdfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e57c0fba-1e3f-4361-ace8-b62af3cf89c7', 'volume_name': 'volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7', 'volume_size': 2, 'snapshot_id': '3e5ae26b-15d7-4563-8230-00c8857f9f7d'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567244f6-16c1-42de-9e86-bfbe4052b57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567244f6-16c1-42de-9e86-bfbe4052b57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:45:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d8c6d8-43c2-4f37-a541-5f97bfc92c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:45:55 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Volume e57c0fba-1e3f-4361-ace8-b62af3cf89c7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7', 'volume_size': 2, 'snapshot_id': '3e5ae26b-15d7-4563-8230-00c8857f9f7d'} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:56 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f" returned: 0 in 0.758s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.361s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-quobyte-3e5ae26b-15d7-4563-8230-00c8857f9f7d-e57c0fba-1e3f-4361-ace8-b62af3cf89c7" by "_create_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-3e5ae26b-15d7-4563-8230-00c8857f9f7d-e57c0fba-1e3f-4361-ace8-b62af3cf89c7" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Creating volume e57c0fba-1e3f-4361-ace8-b62af3cf89c7 from snapshot 3e5ae26b-15d7-4563-8230-00c8857f9f7d {{(pid=86910) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-quobyte-e57c0fba-1e3f-4361-ace8-b62af3cf89c7" by "_copy_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Attempting download of 1b93abc4-d162-4478-b919-a527963e0e4e ((None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}])) to volume 4efe4913-1a8a-4d92-b023-89da24cc648f. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-e57c0fba-1e3f-4361-ace8-b62af3cf89c7" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] snapshot: 3e5ae26b-15d7-4563-8230-00c8857f9f7d, volume: e57c0fba-1e3f-4361-ace8-b62af3cf89c7, {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f7d5bc-6cea-411e-8171-acf75663c44f]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd7a02f-87a2-483c-b70f-8859932c07ba]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_e1k7ohf5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:56 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d Jun 02 00:45:56 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:56 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_e1k7ohf5 Jun 02 00:45:56 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:57 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d" returned: 0 in 0.869s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0798aa30-2820-4b4c-aeba-478626ddb524(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:45:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 00:45:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Creating direct copy from snapshot {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 00:45:57 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[22db9c2f-3e71-4452-8ba2-595ecbb9cff2]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:57 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_e1k7ohf5" returned: 0 in 0.898s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_e1k7ohf5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:57 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 Jun 02 00:45:57 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:57 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_e1k7ohf5 Jun 02 00:45:57 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:58 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_e1k7ohf5" returned: 1 in 0.787s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_e1k7ohf5' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:45:58 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[329c33dc-f3b6-4eb2-9b52-8f2bd8bc90f8]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:45:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_uc9xtff9devstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:58 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524" returned: 0 in 0.874s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:58 devstack cinder-volume[86910]: DEBUG cinder.utils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Path /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7 not found in is_blk_device check {{(pid=86910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 00:45:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:58 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7 Jun 02 00:45:58 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:58 devstack sudo[100648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_uc9xtff9devstack@QuobyteHD Jun 02 00:45:58 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:45:59 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root Jun 02 00:45:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_uc9xtff9devstack@QuobyteHD" returned: 0 in 0.850s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:45:59 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] 1b93abc4-d162-4478-b919-a527963e0e4e was qcow2, converting to raw {{(pid=86910) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 00:45:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_uc9xtff9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:45:59 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_uc9xtff9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f Jun 02 00:45:59 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:04 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:46:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Flow 'volume_create_manager' (4a861a62-d777-44b2-947e-30d5c3a985d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c257d1c-a290-4850-89e0-403a38a8054b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c257d1c-a290-4850-89e0-403a38a8054b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1798805510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1cb548-0ad2-41eb-a616-c3a13847b99c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6488eab3fdca4c48968907a53b8c9d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:04Z,use_quota=True,user_id='f7f3a9b2e53b433293f0d63e66d34020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd05d997-1b15-433f-bb5a-1b2623e6aa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd05d997-1b15-433f-bb5a-1b2623e6aa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84dfa68a-b918-400c-9308-0082e1981551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84dfa68a-b918-400c-9308-0082e1981551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b1cb548-0ad2-41eb-a616-c3a13847b99c', 'volume_name': 'volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88dbc0d-5d0a-4d11-bc78-69ca27362ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88dbc0d-5d0a-4d11-bc78-69ca27362ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e3500f-ea0c-41fb-8ec9-766c357b4592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:04 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume 7b1cb548-0ad2-41eb-a616-c3a13847b99c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c', 'volume_size': 1} Jun 02 00:46:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:05 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_uc9xtff9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f" returned: 0 in 6.367s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:05 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_uc9xtff9devstack@QuobyteHD, size 112.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:46:05 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Converted 112.00 MB image at 17.59 MB/s Jun 02 00:46:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:05 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f 1G Jun 02 00:46:05 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:06 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7" returned: 0 in 8.407s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:06 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac5350e-28e6-41a0-ba94-34e48e55d823]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:06 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 Jun 02 00:46:06 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:06 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f 1G" returned: 0 in 1.423s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:06 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[026940b8-fa8e-4923-8b36-55b1f2dee9e0]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:07 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f Jun 02 00:46:07 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:07 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524" returned: 0 in 1.156s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:07 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Image conversion details: src /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524, size 1024.00 MB, duration 8.41 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7 {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:46:07 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Converted 1024.00 MB image at 121.78 MB/s Jun 02 00:46:07 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7 is being set with open permissions: ugo+rw Jun 02 00:46:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:07 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f" returned: 0 in 0.947s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:07 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7 Jun 02 00:46:07 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:08 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f Jun 02 00:46:08 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:08 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7" returned: 0 in 0.831s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-e57c0fba-1e3f-4361-ace8-b62af3cf89c7" released by "_copy_volume_from_snapshot" :: held 12.257s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-3e5ae26b-15d7-4563-8230-00c8857f9f7d-e57c0fba-1e3f-4361-ace8-b62af3cf89c7" released by "_create_volume_from_snapshot" :: held 12.321s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.352s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.086s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1798805510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1cb548-0ad2-41eb-a616-c3a13847b99c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6488eab3fdca4c48968907a53b8c9d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:04Z,use_quota=True,user_id='f7f3a9b2e53b433293f0d63e66d34020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Creating volume 7b1cb548-0ad2-41eb-a616-c3a13847b99c {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:08 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:46:08 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f" returned: 1 in 0.865s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Downloaded image 1b93abc4-d162-4478-b919-a527963e0e4e ((None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}])) to volume 4efe4913-1a8a-4d92-b023-89da24cc648f successfully. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Temporary image 1b93abc4-d162-4478-b919-a527963e0e4e for user 343d926a0dae43dd81be9d2482069cfe is deleted. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Marking volume 4efe4913-1a8a-4d92-b023-89da24cc648f as bootable. {{(pid=86910) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 00:46:08 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c 1073741824 Jun 02 00:46:08 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Copying metadata from image 1b93abc4-d162-4478-b919-a527963e0e4e to 4efe4913-1a8a-4d92-b023-89da24cc648f. {{(pid=86910) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Creating volume glance metadata for volume 4efe4913-1a8a-4d92-b023-89da24cc648f backed by image 1b93abc4-d162-4478-b919-a527963e0e4e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86910) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d8c6d8-43c2-4f37-a541-5f97bfc92c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7', 'volume_size': 2, 'snapshot_id': '3e5ae26b-15d7-4563-8230-00c8857f9f7d'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f10390-8869-40bc-ad68-f55706ee544a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:08 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Volume volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7 (e57c0fba-1e3f-4361-ace8-b62af3cf89c7): created successfully Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f10390-8869-40bc-ad68-f55706ee544a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Flow 'volume_create_manager' (0bb5252c-70dc-4f98-9a4a-b509248e8683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:08 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-645b2230-eaef-4184-9e9f-a1a7413bf0f5 tempest-VolumesSnapshotTestJSON-1559731239 None] Created volume successfully. Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05c9b8c-44af-4d88-9d48-1f7fa1962a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4efe4913-1a8a-4d92-b023-89da24cc648f', 'volume_size': 1, 'image_id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '213591b260fd4db58e9aae1daeaec391', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'created_at': datetime.datetime(2026, 6, 1, 22, 25, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 25, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b93abc4-d162-4478-b919-a527963e0e4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9edf9af7-4ad3-4224-a687-ab255f3b54ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:09 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Volume volume-4efe4913-1a8a-4d92-b023-89da24cc648f (4efe4913-1a8a-4d92-b023-89da24cc648f): created successfully Jun 02 00:46:09 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9edf9af7-4ad3-4224-a687-ab255f3b54ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:09 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Flow 'volume_create_manager' (dd502850-d3fb-4046-80cc-3f7ef3d87722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:09 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-03e9f66c-410b-4a43-8dfc-f96ab45853df tempest-VolumesGetTest-1454169299 None] Created volume successfully. Jun 02 00:46:09 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c 1073741824" returned: 0 in 0.879s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:09 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c Jun 02 00:46:09 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:09 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-e57c0fba-1e3f-4361-ace8-b62af3cf89c7-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-e57c0fba-1e3f-4361-ace8-b62af3cf89c7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-quobyte-e57c0fba-1e3f-4361-ace8-b62af3cf89c7" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-e57c0fba-1e3f-4361-ace8-b62af3cf89c7" acquired by "delete_volume" :: waited 0.037s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f855c65-ac8c-4e2a-8813-46972beba36d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:10 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7 Jun 02 00:46:10 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Flow 'volume_create_manager' (fe744791-9297-4721-90ce-98ca02c5238a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cab14a-e67d-4763-8753-050dc9bb2d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cab14a-e67d-4763-8753-050dc9bb2d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-154899670',display_name='tempest-VolumesGetTest-Volume-19960020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968b1355-93c0-496c-a2bc-586b6a3004ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7c4dc1569e419aa640495b60c3d4f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:11Z,use_quota=True,user_id='343d926a0dae43dd81be9d2482069cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d46703-2bba-4de3-a4cd-902921bfa47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d46703-2bba-4de3-a4cd-902921bfa47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520c2289-951d-4c36-b86d-8d9cf0e86214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520c2289-951d-4c36-b86d-8d9cf0e86214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '968b1355-93c0-496c-a2bc-586b6a3004ef', 'volume_name': 'volume-968b1355-93c0-496c-a2bc-586b6a3004ef', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d314335-8668-4f8f-96e6-ea23d2eeb4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d314335-8668-4f8f-96e6-ea23d2eeb4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1222f2-a85a-4639-a370-3ff5b490a828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:10 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Volume 968b1355-93c0-496c-a2bc-586b6a3004ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-968b1355-93c0-496c-a2bc-586b6a3004ef', 'volume_size': 1} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:10 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c" returned: 0 in 1.212s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] <== create_volume: return (2157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.160s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.025s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-154899670',display_name='tempest-VolumesGetTest-Volume-19960020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968b1355-93c0-496c-a2bc-586b6a3004ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7c4dc1569e419aa640495b60c3d4f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:11Z,use_quota=True,user_id='343d926a0dae43dd81be9d2482069cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Creating volume 968b1355-93c0-496c-a2bc-586b6a3004ef {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:46:10 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-968b1355-93c0-496c-a2bc-586b6a3004ef 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e3500f-ea0c-41fb-8ec9-766c357b4592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:10 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-968b1355-93c0-496c-a2bc-586b6a3004ef 1073741824 Jun 02 00:46:10 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531ca244-7c5e-4fb6-bbe5-b93dc2e94d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:10 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c (7b1cb548-0ad2-41eb-a616-c3a13847b99c): created successfully Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531ca244-7c5e-4fb6-bbe5-b93dc2e94d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Flow 'volume_create_manager' (4a861a62-d777-44b2-947e-30d5c3a985d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:10 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-8ad11a7b-5f8d-4562-bd85-7e6800c4ad9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Created volume successfully. Jun 02 00:46:11 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7" returned: 0 in 1.118s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:11 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7 Jun 02 00:46:11 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:11 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-968b1355-93c0-496c-a2bc-586b6a3004ef 1073741824" returned: 0 in 1.057s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:11 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e57c0fba-1e3f-4361-ace8-b62af3cf89c7" returned: 0 in 0.709s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-e57c0fba-1e3f-4361-ace8-b62af3cf89c7" released by "delete_volume" :: held 1.890s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-968b1355-93c0-496c-a2bc-586b6a3004ef {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:12 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-968b1355-93c0-496c-a2bc-586b6a3004ef Jun 02 00:46:12 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Created reservations ['1400220b-e2c0-4305-a103-5ddd3479d3ee', '1fb8c77c-09f6-4246-9e37-5fabb5e7ca4d', '2cf58b15-ad69-4141-b1a1-613b1a7efd07', 'b019bb12-44df-4b1e-a8f7-12047d48681c'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:12 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:46:12 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-3e5ae26b-15d7-4563-8230-00c8857f9f7d-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-3e5ae26b-15d7-4563-8230-00c8857f9f7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-quobyte-0798aa30-2820-4b4c-aeba-478626ddb524" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-0798aa30-2820-4b4c-aeba-478626ddb524" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-quobyte-3e5ae26b-15d7-4563-8230-00c8857f9f7d" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-3e5ae26b-15d7-4563-8230-00c8857f9f7d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] Deleting offline snapshot 3e5ae26b-15d7-4563-8230-00c8857f9f7d of volume 0798aa30-2820-4b4c-aeba-478626ddb524 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] snapshot_file for this snap is: volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b3657c-dd04-4648-ad12-e9beb1a52df9]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:12 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d Jun 02 00:46:12 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:12 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-968b1355-93c0-496c-a2bc-586b6a3004ef" returned: 0 in 0.792s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.640s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1222f2-a85a-4639-a370-3ff5b490a828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-968b1355-93c0-496c-a2bc-586b6a3004ef', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4423932f-d979-4c6f-a29a-31e800d3883d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] Creating offline snapshot 909b11e5-25bf-46ea-8944-58f1b7fbb8b3 of volume 7b1cb548-0ad2-41eb-a616-c3a13847b99c {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:46:12 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Volume volume-968b1355-93c0-496c-a2bc-586b6a3004ef (968b1355-93c0-496c-a2bc-586b6a3004ef): created successfully Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4423932f-d979-4c6f-a29a-31e800d3883d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Flow 'volume_create_manager' (fe744791-9297-4721-90ce-98ca02c5238a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac98a71-2cdd-4a3a-805f-5480657815ee]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:12 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-68ee5e9e-af7b-4a8d-993f-ba7d009c18cd tempest-VolumesGetTest-1454169299 None] Created volume successfully. Jun 02 00:46:13 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c Jun 02 00:46:13 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:13 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.890s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:13 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:46:13 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Deleted volume successfully. Jun 02 00:46:13 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a22368e4-1b5d-40b0-ae80-b18f758b3d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-e57c0fba-1e3f-4361-ace8-b62af3cf89c7-delete_volume" released by "delete_volume" :: held 3.177s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:13 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d" returned: 0 in 0.911s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0798aa30-2820-4b4c-aeba-478626ddb524(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:46:13 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1c9ebf-4c5c-4ea5-8aaf-c08f7b302902]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:13 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 Jun 02 00:46:13 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:13 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c" returned: 0 in 0.839s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:13 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3 1G Jun 02 00:46:13 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] Acquiring lock "cinder-968b1355-93c0-496c-a2bc-586b6a3004ef-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] Lock "cinder-968b1355-93c0-496c-a2bc-586b6a3004ef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] Acquiring lock "cinder-quobyte-968b1355-93c0-496c-a2bc-586b6a3004ef" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-968b1355-93c0-496c-a2bc-586b6a3004ef" acquired by "delete_volume" :: waited 0.027s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:14 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3875e497-e09c-44b4-818f-1e350cd63056]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:14 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-968b1355-93c0-496c-a2bc-586b6a3004ef {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524" returned: 0 in 0.938s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:14 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d Jun 02 00:46:14 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:14 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-968b1355-93c0-496c-a2bc-586b6a3004ef Jun 02 00:46:14 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:14 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3 1G" returned: 0 in 0.912s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:14 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3 Jun 02 00:46:14 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:46:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:15 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:46:15 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:15 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-968b1355-93c0-496c-a2bc-586b6a3004ef" returned: 0 in 0.832s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-968b1355-93c0-496c-a2bc-586b6a3004ef {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:15 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-968b1355-93c0-496c-a2bc-586b6a3004ef Jun 02 00:46:15 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:15 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d" returned: 0 in 0.859s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:15 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d Jun 02 00:46:15 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:15 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3" returned: 0 in 0.723s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:15 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3 is being set with open permissions: ugo+rw Jun 02 00:46:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:15 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3 Jun 02 00:46:15 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:15 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.679s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:15 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:46:15 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-968b1355-93c0-496c-a2bc-586b6a3004ef" returned: 0 in 0.669s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-968b1355-93c0-496c-a2bc-586b6a3004ef" released by "delete_volume" :: held 1.549s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:16 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524.3e5ae26b-15d7-4563-8230-00c8857f9f7d" returned: 0 in 0.687s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] Created reservations ['d328a42b-26d9-4579-bb21-85da197d298b', '032f2426-0e78-45fd-ae92-9c6d59f590cc', '90591389-bc0f-42bd-a493-d40c831216de', '88c32be0-fe06-43fc-8a80-26565525b667'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-3e5ae26b-15d7-4563-8230-00c8857f9f7d" released by "_delete_snapshot" :: held 3.527s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-0798aa30-2820-4b4c-aeba-478626ddb524" released by "delete_snapshot" :: held 3.561s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:16 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3" returned: 0 in 0.707s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:16 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:46:16 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] Created reservations ['da551f52-081c-42be-ac77-cfc350f09b76', '93bb140f-c769-4e39-918f-7dfb775417b2', 'daf445e9-4512-41a0-9c5c-1e32e460f3c8', '6304b4f0-4b6d-48b1-950d-fd4211d111fa'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:16 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.info Jun 02 00:46:16 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:16 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] Delete snapshot completed successfully. Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e961b28-3b9c-4c1d-b7eb-b89b4fca2563 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-3e5ae26b-15d7-4563-8230-00c8857f9f7d-delete_snapshot" released by "delete_snapshot" :: held 3.779s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Acquiring lock "cinder-4efe4913-1a8a-4d92-b023-89da24cc648f-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Lock "cinder-4efe4913-1a8a-4d92-b023-89da24cc648f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Acquiring lock "cinder-quobyte-4efe4913-1a8a-4d92-b023-89da24cc648f" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-4efe4913-1a8a-4d92-b023-89da24cc648f" acquired by "delete_volume" :: waited 0.030s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:16 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.639s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:46:16 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] Deleted volume successfully. Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-a37c32b4-854e-4e84-9513-79ad8350b3ed tempest-VolumesGetTest-1454169299 None] Lock "cinder-968b1355-93c0-496c-a2bc-586b6a3004ef-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19f99ff-d736-4d3e-955a-4b50f51e3a54]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-0798aa30-2820-4b4c-aeba-478626ddb524-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-0798aa30-2820-4b4c-aeba-478626ddb524-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:16 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.info" returned: 0 in 0.686s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:16 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.info is being set with open permissions: ugo+rw Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:16 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.info Jun 02 00:46:16 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-quobyte-0798aa30-2820-4b4c-aeba-478626ddb524" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:16 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f Jun 02 00:46:16 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-0798aa30-2820-4b4c-aeba-478626ddb524" acquired by "delete_volume" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8315e32f-c067-4cf2-be05-6a70a6264f51]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:17 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 Jun 02 00:46:17 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:17 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.info" returned: 0 in 0.630s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.687s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:17 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:17 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-3065ca16-d971-41e7-bb92-83d96da3e9fa tempest-CreateVolumesFromSnapshotTest-1313124232 None] Create snapshot completed successfully Jun 02 00:46:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f" returned: 0 in 0.735s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:17 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f Jun 02 00:46:17 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:17 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524" returned: 0 in 0.717s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:17 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524 Jun 02 00:46:17 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:18 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f" returned: 1 in 0.706s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:46:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:18 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f Jun 02 00:46:18 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:18 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0798aa30-2820-4b4c-aeba-478626ddb524" returned: 0 in 0.599s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:18 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-0798aa30-2820-4b4c-aeba-478626ddb524" released by "delete_volume" :: held 1.376s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:18 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] Created reservations ['e257cfe6-c97b-4896-99ab-2d7c0aa71972', 'a18dab47-8bd3-42c2-8f1d-c369fe1a489c', '8aec0543-08ce-4872-8a19-07a9e49889e6', '39bd9791-93a6-4ee1-9d55-4d1986a09b1d'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:46:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:18 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:46:18 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:18 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:46:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Flow 'volume_create_manager' (80e24255-fb18-4831-ada8-c579e4d3c86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dbdb58f-967d-480e-88b7-ef53d19d6d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:18 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4efe4913-1a8a-4d92-b023-89da24cc648f" returned: 0 in 0.724s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dbdb58f-967d-480e-88b7-ef53d19d6d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-538359703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76855a3e-8418-4c97-8358-c032286f5a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6488eab3fdca4c48968907a53b8c9d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:19Z,use_quota=True,user_id='f7f3a9b2e53b433293f0d63e66d34020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2166c8-db2d-47a6-ad60-456e2d6dd532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2166c8-db2d-47a6-ad60-456e2d6dd532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbeff78-ede0-4d51-a5bc-6ef8d1dc7b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbeff78-ede0-4d51-a5bc-6ef8d1dc7b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76855a3e-8418-4c97-8358-c032286f5a68', 'volume_name': 'volume-76855a3e-8418-4c97-8358-c032286f5a68', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5863d78-f9dd-4548-bc25-de49e8d7ba40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5863d78-f9dd-4548-bc25-de49e8d7ba40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b93dc4-971d-48bc-876e-3c6775588ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:19 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume 76855a3e-8418-4c97-8358-c032286f5a68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76855a3e-8418-4c97-8358-c032286f5a68', 'volume_size': 1} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-538359703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76855a3e-8418-4c97-8358-c032286f5a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6488eab3fdca4c48968907a53b8c9d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:19Z,use_quota=True,user_id='f7f3a9b2e53b433293f0d63e66d34020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Creating volume 76855a3e-8418-4c97-8358-c032286f5a68 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:46:19 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76855a3e-8418-4c97-8358-c032286f5a68 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Lock "cinder-quobyte-4efe4913-1a8a-4d92-b023-89da24cc648f" released by "delete_volume" :: held 2.341s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:19 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.659s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:46:19 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76855a3e-8418-4c97-8358-c032286f5a68 1073741824 Jun 02 00:46:19 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:19 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] Deleted volume successfully. Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-04c1a6c5-24df-4a4c-94c8-bde9849db0ad tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-0798aa30-2820-4b4c-aeba-478626ddb524-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Created reservations ['ce944fe6-a44e-424b-8b2f-86adb1aa24d6', '7edd7e37-d6d5-4cd5-969d-384ab04fdb67', '4282c537-a12d-4a67-8015-e8358a5e65b8', 'ba8622f9-db38-4d82-a28c-dda4e097166c'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:19 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:46:19 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Flow 'volume_create_manager' (8467633d-7f8e-46ec-86a1-d93ec6960d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f093abbf-a95c-424f-9392-8d577ebe6ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f093abbf-a95c-424f-9392-8d577ebe6ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-266038699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67fe5c2e-e609-4fc4-aa4d-f357345773e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6488eab3fdca4c48968907a53b8c9d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:19Z,use_quota=True,user_id='f7f3a9b2e53b433293f0d63e66d34020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60ebe49-9cc5-4a2d-9348-502a51f62128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60ebe49-9cc5-4a2d-9348-502a51f62128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef644998-abf1-44c3-b7bf-0bcfec1ffe5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef644998-abf1-44c3-b7bf-0bcfec1ffe5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67fe5c2e-e609-4fc4-aa4d-f357345773e0', 'volume_name': 'volume-67fe5c2e-e609-4fc4-aa4d-f357345773e0', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068357b9-7ee0-4f32-aaf5-c6b780bfc68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068357b9-7ee0-4f32-aaf5-c6b780bfc68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53837d74-58c8-464d-8fb2-c3a9f12548a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:19 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume 67fe5c2e-e609-4fc4-aa4d-f357345773e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67fe5c2e-e609-4fc4-aa4d-f357345773e0', 'volume_size': 1} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Flow 'volume_create_manager' (dc084589-43ca-4ce5-9e31-8c8e80fed901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e2e706-9579-4ebc-9b31-6c485eb93281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e2e706-9579-4ebc-9b31-6c485eb93281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1005470226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f0db0a9-4bff-4d5d-b55f-f263fd50efba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6488eab3fdca4c48968907a53b8c9d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:20Z,use_quota=True,user_id='f7f3a9b2e53b433293f0d63e66d34020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b03f908-a9c3-4e7b-ad8e-78ece7d188d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b03f908-a9c3-4e7b-ad8e-78ece7d188d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c876c208-7e3e-4907-bba6-0a4709b418e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c876c208-7e3e-4907-bba6-0a4709b418e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f0db0a9-4bff-4d5d-b55f-f263fd50efba', 'volume_name': 'volume-6f0db0a9-4bff-4d5d-b55f-f263fd50efba', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d111e73-1da6-429e-960c-dea3bfb34812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d111e73-1da6-429e-960c-dea3bfb34812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa840bb-1c51-430b-8cdc-13b08d7e4d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:19 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume 6f0db0a9-4bff-4d5d-b55f-f263fd50efba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f0db0a9-4bff-4d5d-b55f-f263fd50efba', 'volume_size': 1} Jun 02 00:46:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Flow 'volume_create_manager' (f5bce52c-0a01-41d8-852d-0a8c069731c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd63cc00-809f-4a1e-8e99-b8ed15f0bd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd63cc00-809f-4a1e-8e99-b8ed15f0bd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1845434941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e955cce8-da4d-4fed-a695-5f8192a75d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30f685aa40545e1aeacf7788f39a23f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:20Z,use_quota=True,user_id='ecb169ff4af64bd68f12962ffe2fec9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60263495-cfe8-4296-b2ca-171fe8231b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60263495-cfe8-4296-b2ca-171fe8231b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7444b09c-710b-4a86-b9d7-943fbb879704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7444b09c-710b-4a86-b9d7-943fbb879704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e955cce8-da4d-4fed-a695-5f8192a75d9f', 'volume_name': 'volume-e955cce8-da4d-4fed-a695-5f8192a75d9f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b362ad-e164-4cea-9fd2-0d8e12ef9475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b362ad-e164-4cea-9fd2-0d8e12ef9475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1579ae4-dc72-44c8-a6d7-ba4b6b5dc19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:20 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Volume e955cce8-da4d-4fed-a695-5f8192a75d9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e955cce8-da4d-4fed-a695-5f8192a75d9f', 'volume_size': 1} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Flow 'volume_create_manager' (66fc1266-30fd-4ee0-900c-2dfcecd1fe8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec24440-4e30-4b82-b442-859f6cb878be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:20 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec24440-4e30-4b82-b442-859f6cb878be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-805850100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7902597-56f0-420e-99a5-411c0e313529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6488eab3fdca4c48968907a53b8c9d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:20Z,use_quota=True,user_id='f7f3a9b2e53b433293f0d63e66d34020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63245d4e-9b43-49bc-9a75-d061d9da2ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63245d4e-9b43-49bc-9a75-d061d9da2ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d452b0b-6cb4-4581-b446-5e78ab04a926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d452b0b-6cb4-4581-b446-5e78ab04a926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7902597-56f0-420e-99a5-411c0e313529', 'volume_name': 'volume-c7902597-56f0-420e-99a5-411c0e313529', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63755c9e-fe2b-458b-8508-669980c10938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63755c9e-fe2b-458b-8508-669980c10938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a4bd8f-a800-4140-85da-2bad6264cb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:20 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume c7902597-56f0-420e-99a5-411c0e313529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7902597-56f0-420e-99a5-411c0e313529', 'volume_size': 1} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.983s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:46:20 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Deleted volume successfully. Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b375a535-340a-4b18-ba2f-6124c2bcb4df tempest-VolumesGetTest-1454169299 None] Lock "cinder-4efe4913-1a8a-4d92-b023-89da24cc648f-delete_volume" released by "delete_volume" :: held 3.717s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:20 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76855a3e-8418-4c97-8358-c032286f5a68 1073741824" returned: 0 in 1.333s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76855a3e-8418-4c97-8358-c032286f5a68 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:20 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76855a3e-8418-4c97-8358-c032286f5a68 Jun 02 00:46:20 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Flow 'volume_create_manager' (3fb2e3c8-4ec7-40a9-b504-148023d940db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6abe30-97d1-431f-bdbf-0de4eea59f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6abe30-97d1-431f-bdbf-0de4eea59f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-506104162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a9c8d9-09a8-4f76-9562-26c0299371cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6488eab3fdca4c48968907a53b8c9d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:21Z,use_quota=True,user_id='f7f3a9b2e53b433293f0d63e66d34020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe942db-24a2-454e-847c-55826340332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe942db-24a2-454e-847c-55826340332f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e083b4-a650-4ccb-83fe-b3fe918049c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e083b4-a650-4ccb-83fe-b3fe918049c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9a9c8d9-09a8-4f76-9562-26c0299371cb', 'volume_name': 'volume-e9a9c8d9-09a8-4f76-9562-26c0299371cb', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1dd74a-0084-40ac-931d-77b875c5c2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1dd74a-0084-40ac-931d-77b875c5c2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd604cc3-900b-4168-b12b-063ad2f15785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:20 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume e9a9c8d9-09a8-4f76-9562-26c0299371cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9a9c8d9-09a8-4f76-9562-26c0299371cb', 'volume_size': 1} Jun 02 00:46:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:21 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76855a3e-8418-4c97-8358-c032286f5a68" returned: 0 in 0.816s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:46:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.199s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.669s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-266038699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67fe5c2e-e609-4fc4-aa4d-f357345773e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6488eab3fdca4c48968907a53b8c9d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:19Z,use_quota=True,user_id='f7f3a9b2e53b433293f0d63e66d34020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:46:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Creating volume 67fe5c2e-e609-4fc4-aa4d-f357345773e0 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:46:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:46:21 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:46:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-67fe5c2e-e609-4fc4-aa4d-f357345773e0 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:21 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-67fe5c2e-e609-4fc4-aa4d-f357345773e0 1073741824 Jun 02 00:46:21 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b93dc4-971d-48bc-876e-3c6775588ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76855a3e-8418-4c97-8358-c032286f5a68', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030d895a-0477-4f0a-8da5-4653d9451944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:21 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume volume-76855a3e-8418-4c97-8358-c032286f5a68 (76855a3e-8418-4c97-8358-c032286f5a68): created successfully Jun 02 00:46:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030d895a-0477-4f0a-8da5-4653d9451944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Flow 'volume_create_manager' (80e24255-fb18-4831-ada8-c579e4d3c86f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:21 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-2fe0400e-6030-4a03-9330-5935970a1016 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Created volume successfully. Jun 02 00:46:22 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-67fe5c2e-e609-4fc4-aa4d-f357345773e0 1073741824" returned: 0 in 0.920s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-67fe5c2e-e609-4fc4-aa4d-f357345773e0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:22 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-67fe5c2e-e609-4fc4-aa4d-f357345773e0 Jun 02 00:46:22 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:22 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-67fe5c2e-e609-4fc4-aa4d-f357345773e0" returned: 0 in 0.626s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.875s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1005470226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f0db0a9-4bff-4d5d-b55f-f263fd50efba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6488eab3fdca4c48968907a53b8c9d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:20Z,use_quota=True,user_id='f7f3a9b2e53b433293f0d63e66d34020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Creating volume 6f0db0a9-4bff-4d5d-b55f-f263fd50efba {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:46:22 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6f0db0a9-4bff-4d5d-b55f-f263fd50efba 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:22 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6f0db0a9-4bff-4d5d-b55f-f263fd50efba 1073741824 Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53837d74-58c8-464d-8fb2-c3a9f12548a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67fe5c2e-e609-4fc4-aa4d-f357345773e0', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:22 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9d2e1b-5222-4fb7-8022-f2e8ea3393a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:22 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume volume-67fe5c2e-e609-4fc4-aa4d-f357345773e0 (67fe5c2e-e609-4fc4-aa4d-f357345773e0): created successfully Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9d2e1b-5222-4fb7-8022-f2e8ea3393a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Flow 'volume_create_manager' (8467633d-7f8e-46ec-86a1-d93ec6960d49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:22 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-0f3025df-806f-4183-85ce-79186a6df967 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Created volume successfully. Jun 02 00:46:23 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:46:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Flow 'volume_create_manager' (ec1f97fc-1244-46c9-a824-6dc1ab158a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5129289-b202-4148-9e51-e800e9ef21f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5129289-b202-4148-9e51-e800e9ef21f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-140809961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41551ac9-b492-4720-a7c8-90fc4d54c09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71adfbfd0f9d47438471de690616e5c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:23Z,use_quota=True,user_id='a0cbb1aac7a74c39a757eb1210500659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14c3cb9-d04f-43de-9bb6-39fd246bc9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14c3cb9-d04f-43de-9bb6-39fd246bc9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11719e6b-07d6-4c9a-9b8a-8f3583bf9b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11719e6b-07d6-4c9a-9b8a-8f3583bf9b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41551ac9-b492-4720-a7c8-90fc4d54c09d', 'volume_name': 'volume-41551ac9-b492-4720-a7c8-90fc4d54c09d', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90f127c-2c34-43f7-bd20-47c335c31887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90f127c-2c34-43f7-bd20-47c335c31887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:23 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b2185b-2fc9-4326-ab90-6510683f769a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:23 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Volume 41551ac9-b492-4720-a7c8-90fc4d54c09d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41551ac9-b492-4720-a7c8-90fc4d54c09d', 'volume_size': 1} Jun 02 00:46:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:23 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6f0db0a9-4bff-4d5d-b55f-f263fd50efba 1073741824" returned: 0 in 0.865s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6f0db0a9-4bff-4d5d-b55f-f263fd50efba {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:23 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6f0db0a9-4bff-4d5d-b55f-f263fd50efba Jun 02 00:46:23 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:24 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6f0db0a9-4bff-4d5d-b55f-f263fd50efba" returned: 0 in 0.599s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:46:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.163s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1845434941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e955cce8-da4d-4fed-a695-5f8192a75d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30f685aa40545e1aeacf7788f39a23f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:20Z,use_quota=True,user_id='ecb169ff4af64bd68f12962ffe2fec9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:46:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Creating volume e955cce8-da4d-4fed-a695-5f8192a75d9f {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:46:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:46:24 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:46:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa840bb-1c51-430b-8cdc-13b08d7e4d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f0db0a9-4bff-4d5d-b55f-f263fd50efba', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:24 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f 1073741824 Jun 02 00:46:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f26685-f423-42a5-9809-86d510c23942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:24 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:24 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume volume-6f0db0a9-4bff-4d5d-b55f-f263fd50efba (6f0db0a9-4bff-4d5d-b55f-f263fd50efba): created successfully Jun 02 00:46:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f26685-f423-42a5-9809-86d510c23942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:24 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Flow 'volume_create_manager' (dc084589-43ca-4ce5-9e31-8c8e80fed901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:24 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-d45c5335-9993-43ad-a70d-3b17621b41c5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Created volume successfully. Jun 02 00:46:25 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f 1073741824" returned: 0 in 0.747s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:25 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f Jun 02 00:46:25 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:25 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f" returned: 0 in 0.580s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.401s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-805850100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7902597-56f0-420e-99a5-411c0e313529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6488eab3fdca4c48968907a53b8c9d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:20Z,use_quota=True,user_id='f7f3a9b2e53b433293f0d63e66d34020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Creating volume c7902597-56f0-420e-99a5-411c0e313529 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:46:25 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c7902597-56f0-420e-99a5-411c0e313529 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:25 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c7902597-56f0-420e-99a5-411c0e313529 1073741824 Jun 02 00:46:25 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1579ae4-dc72-44c8-a6d7-ba4b6b5dc19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e955cce8-da4d-4fed-a695-5f8192a75d9f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7b9d73-39d9-4cbb-80b7-06bf5287c61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:25 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Volume volume-e955cce8-da4d-4fed-a695-5f8192a75d9f (e955cce8-da4d-4fed-a695-5f8192a75d9f): created successfully Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7b9d73-39d9-4cbb-80b7-06bf5287c61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Flow 'volume_create_manager' (f5bce52c-0a01-41d8-852d-0a8c069731c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:25 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ae74a846-0a44-43e4-8cfe-6c261821c0c8 tempest-VolumesSnapshotTestJSON-1559731239 None] Created volume successfully. Jun 02 00:46:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:26 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c7902597-56f0-420e-99a5-411c0e313529 1073741824" returned: 0 in 0.795s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c7902597-56f0-420e-99a5-411c0e313529 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:26 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c7902597-56f0-420e-99a5-411c0e313529 Jun 02 00:46:26 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:27 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c7902597-56f0-420e-99a5-411c0e313529" returned: 0 in 0.605s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.224s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-506104162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a9c8d9-09a8-4f76-9562-26c0299371cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6488eab3fdca4c48968907a53b8c9d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:21Z,use_quota=True,user_id='f7f3a9b2e53b433293f0d63e66d34020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Creating volume e9a9c8d9-09a8-4f76-9562-26c0299371cb {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:46:27 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e9a9c8d9-09a8-4f76-9562-26c0299371cb 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a4bd8f-a800-4140-85da-2bad6264cb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7902597-56f0-420e-99a5-411c0e313529', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:27 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e9a9c8d9-09a8-4f76-9562-26c0299371cb 1073741824 Jun 02 00:46:27 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27699769-c0f9-4e7d-84de-f47e113cbe81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:27 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume volume-c7902597-56f0-420e-99a5-411c0e313529 (c7902597-56f0-420e-99a5-411c0e313529): created successfully Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27699769-c0f9-4e7d-84de-f47e113cbe81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Flow 'volume_create_manager' (66fc1266-30fd-4ee0-900c-2dfcecd1fe8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:27 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-7c8a648e-4c4f-4e98-b0be-c90bc9defab5 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Created volume successfully. Jun 02 00:46:27 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e9a9c8d9-09a8-4f76-9562-26c0299371cb 1073741824" returned: 0 in 0.787s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e9a9c8d9-09a8-4f76-9562-26c0299371cb {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:28 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e9a9c8d9-09a8-4f76-9562-26c0299371cb Jun 02 00:46:28 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:28 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e9a9c8d9-09a8-4f76-9562-26c0299371cb" returned: 0 in 0.602s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.113s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-140809961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41551ac9-b492-4720-a7c8-90fc4d54c09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71adfbfd0f9d47438471de690616e5c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:23Z,use_quota=True,user_id='a0cbb1aac7a74c39a757eb1210500659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Creating volume 41551ac9-b492-4720-a7c8-90fc4d54c09d {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:46:28 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-41551ac9-b492-4720-a7c8-90fc4d54c09d 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=134,cinder:SELECT=106,cinder:DELETE=10,cinder:INSERT=34 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd604cc3-900b-4168-b12b-063ad2f15785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9a9c8d9-09a8-4f76-9562-26c0299371cb', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:28 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-41551ac9-b492-4720-a7c8-90fc4d54c09d 1073741824 Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82bc4d80-7556-4d5e-bff5-ad8c6994c755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:28 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=119,cinder:SELECT=108,cinder:INSERT=36,cinder:DELETE=15 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:46:28 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Volume volume-e9a9c8d9-09a8-4f76-9562-26c0299371cb (e9a9c8d9-09a8-4f76-9562-26c0299371cb): created successfully Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82bc4d80-7556-4d5e-bff5-ad8c6994c755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:28 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Flow 'volume_create_manager' (3fb2e3c8-4ec7-40a9-b504-148023d940db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:28 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-d96b83cf-808a-4533-a806-dc81eb443e31 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Created volume successfully. Jun 02 00:46:29 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-41551ac9-b492-4720-a7c8-90fc4d54c09d 1073741824" returned: 0 in 0.771s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-41551ac9-b492-4720-a7c8-90fc4d54c09d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:29 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-41551ac9-b492-4720-a7c8-90fc4d54c09d Jun 02 00:46:29 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "cinder-e9a9c8d9-09a8-4f76-9562-26c0299371cb-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-e9a9c8d9-09a8-4f76-9562-26c0299371cb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "cinder-quobyte-e9a9c8d9-09a8-4f76-9562-26c0299371cb" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-quobyte-e9a9c8d9-09a8-4f76-9562-26c0299371cb" acquired by "delete_volume" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:29 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[570dd609-074c-4690-a08d-e4043f1c7067]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e9a9c8d9-09a8-4f76-9562-26c0299371cb {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:29 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e9a9c8d9-09a8-4f76-9562-26c0299371cb Jun 02 00:46:29 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:30 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-41551ac9-b492-4720-a7c8-90fc4d54c09d" returned: 0 in 0.613s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:46:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.625s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b2185b-2fc9-4326-ab90-6510683f769a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41551ac9-b492-4720-a7c8-90fc4d54c09d', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d83e5b-4acc-4380-bc4b-9bbd7ae15a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] Creating offline snapshot 2e8038b7-138b-4fbb-af13-98fd05e35d87 of volume e955cce8-da4d-4fed-a695-5f8192a75d9f {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:46:30 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Volume volume-41551ac9-b492-4720-a7c8-90fc4d54c09d (41551ac9-b492-4720-a7c8-90fc4d54c09d): created successfully Jun 02 00:46:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d83e5b-4acc-4380-bc4b-9bbd7ae15a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:30 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Flow 'volume_create_manager' (ec1f97fc-1244-46c9-a824-6dc1ab158a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:30 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd7285d-21c7-4f97-9fb7-97a3dcc0866c]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:30 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-0178d777-cc55-4170-89bf-2d0048828c83 tempest-VolumesNegativeTest-374594760 None] Created volume successfully. Jun 02 00:46:30 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f Jun 02 00:46:30 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:30 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e9a9c8d9-09a8-4f76-9562-26c0299371cb" returned: 0 in 0.729s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e9a9c8d9-09a8-4f76-9562-26c0299371cb {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:30 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e9a9c8d9-09a8-4f76-9562-26c0299371cb Jun 02 00:46:30 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:30 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f" returned: 0 in 0.781s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:30 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87 1G Jun 02 00:46:30 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:30 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e9a9c8d9-09a8-4f76-9562-26c0299371cb" returned: 0 in 0.634s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-quobyte-e9a9c8d9-09a8-4f76-9562-26c0299371cb" released by "delete_volume" :: held 1.423s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Created reservations ['06db1bfc-60bc-42ef-b166-e7de32840019', '3a0f5cc9-dd2d-4000-9d2b-5b30f4dbae7d', '3e549f6d-2f22-4432-b6e7-305c4ed14740', '50d71d43-7914-4141-ac81-75ab83d0f98f'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:31 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:46:31 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-1acaaa2c-f061-4171-82ee-044cefa15dc4 req-efc206db-c3a6-4a17-8138-bc47a03b2ab9 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "cinder-c7902597-56f0-420e-99a5-411c0e313529-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-c7902597-56f0-420e-99a5-411c0e313529-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "cinder-quobyte-c7902597-56f0-420e-99a5-411c0e313529" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-quobyte-c7902597-56f0-420e-99a5-411c0e313529" acquired by "delete_volume" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fce6131-f515-4df6-9700-1ec2da995be7]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c7902597-56f0-420e-99a5-411c0e313529 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:31 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87 1G" returned: 0 in 1.009s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e955cce8-da4d-4fed-a695-5f8192a75d9f -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:31 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e955cce8-da4d-4fed-a695-5f8192a75d9f -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87 Jun 02 00:46:31 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:31 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.749s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:31 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:46:31 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Deleted volume successfully. Jun 02 00:46:32 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c2fdad2f-7231-4721-9fba-5fad1f31db9f tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-e9a9c8d9-09a8-4f76-9562-26c0299371cb-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:32 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c7902597-56f0-420e-99a5-411c0e313529 Jun 02 00:46:32 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:32 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e955cce8-da4d-4fed-a695-5f8192a75d9f -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87" returned: 0 in 0.658s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:32 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87 is being set with open permissions: ugo+rw Jun 02 00:46:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:32 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87 Jun 02 00:46:32 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:32 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c7902597-56f0-420e-99a5-411c0e313529" returned: 0 in 0.889s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c7902597-56f0-420e-99a5-411c0e313529 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:32 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c7902597-56f0-420e-99a5-411c0e313529 Jun 02 00:46:32 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:33 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87" returned: 0 in 0.655s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:33 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.info Jun 02 00:46:33 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:33 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c7902597-56f0-420e-99a5-411c0e313529" returned: 0 in 0.607s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:33 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-quobyte-c7902597-56f0-420e-99a5-411c0e313529" released by "delete_volume" :: held 1.556s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:33 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Created reservations ['e2869aa3-d058-4ef2-8b38-af8cd9c66aa1', 'cf9a360b-6922-4db3-aa5d-fad57e2e8af4', '59270265-c005-4b32-9df6-6d4570e7255f', '32968288-d058-409c-a91b-a6c49d4e6887'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:46:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:33 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:46:33 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:33 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.info" returned: 0 in 0.628s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:33 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.info is being set with open permissions: ugo+rw Jun 02 00:46:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:33 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.info Jun 02 00:46:33 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "cinder-6f0db0a9-4bff-4d5d-b55f-f263fd50efba-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-6f0db0a9-4bff-4d5d-b55f-f263fd50efba-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "cinder-quobyte-6f0db0a9-4bff-4d5d-b55f-f263fd50efba" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:34 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-quobyte-6f0db0a9-4bff-4d5d-b55f-f263fd50efba" acquired by "delete_volume" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.676s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:34 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:46:34 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Deleted volume successfully. Jun 02 00:46:34 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[902e0d53-0d71-4b63-97cf-e214831ea05d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6f0db0a9-4bff-4d5d-b55f-f263fd50efba {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-525a20ad-c85d-4d24-96a8-cdcb1f845e83 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-c7902597-56f0-420e-99a5-411c0e313529-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:34 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6f0db0a9-4bff-4d5d-b55f-f263fd50efba Jun 02 00:46:34 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:34 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.info" returned: 0 in 0.650s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.519s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-1acaaa2c-f061-4171-82ee-044cefa15dc4 req-efc206db-c3a6-4a17-8138-bc47a03b2ab9 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.064s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:34 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[32648e4d-bb49-4db6-ba65-80b2f93c8917]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-1acaaa2c-f061-4171-82ee-044cefa15dc4 req-efc206db-c3a6-4a17-8138-bc47a03b2ab9 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bdc7c04f-cd2a-484b-b251-32553978a89b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:34 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-7e300699-ca28-4ca0-b625-9ad1e312726c tempest-VolumesSnapshotTestJSON-1559731239 None] Create snapshot completed successfully Jun 02 00:46:34 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bdc7c04f-cd2a-484b-b251-32553978a89b Jun 02 00:46:34 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:34 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6f0db0a9-4bff-4d5d-b55f-f263fd50efba" returned: 0 in 0.767s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6f0db0a9-4bff-4d5d-b55f-f263fd50efba {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:35 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6f0db0a9-4bff-4d5d-b55f-f263fd50efba Jun 02 00:46:35 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Flow 'volume_create_manager' (e5731305-e215-4ef2-9c14-d1f46db2ea6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fb3667-c163-483e-9d40-a4f6ef4e849d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:35 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-1acaaa2c-f061-4171-82ee-044cefa15dc4 req-efc206db-c3a6-4a17-8138-bc47a03b2ab9 tempest-TestServerVolumeAttachmentScenario-1881965009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bdc7c04f-cd2a-484b-b251-32553978a89b" returned: 0 in 0.849s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-1acaaa2c-f061-4171-82ee-044cefa15dc4 req-efc206db-c3a6-4a17-8138-bc47a03b2ab9 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.874s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fb3667-c163-483e-9d40-a4f6ef4e849d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-285100686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0944dc18-3569-43db-980d-0aebed629c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30f685aa40545e1aeacf7788f39a23f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2e8038b7-138b-4fbb-af13-98fd05e35d87,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:35Z,use_quota=True,user_id='ecb169ff4af64bd68f12962ffe2fec9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e35c87-7a86-43e9-be01-60326b5fce34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e35c87-7a86-43e9-be01-60326b5fce34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c749489-c32a-4779-89ee-8257b4b662a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c749489-c32a-4779-89ee-8257b4b662a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0944dc18-3569-43db-980d-0aebed629c76', 'volume_name': 'volume-0944dc18-3569-43db-980d-0aebed629c76', 'volume_size': 1, 'snapshot_id': '2e8038b7-138b-4fbb-af13-98fd05e35d87'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f350d00-a084-4baf-8495-31b5972a1045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f350d00-a084-4baf-8495-31b5972a1045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c784a1-1c9e-4635-a46c-48ae3d36c915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:35 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Volume 0944dc18-3569-43db-980d-0aebed629c76: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0944dc18-3569-43db-980d-0aebed629c76', 'volume_size': 1, 'snapshot_id': '2e8038b7-138b-4fbb-af13-98fd05e35d87'} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-quobyte-2e8038b7-138b-4fbb-af13-98fd05e35d87-0944dc18-3569-43db-980d-0aebed629c76" by "_create_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-2e8038b7-138b-4fbb-af13-98fd05e35d87-0944dc18-3569-43db-980d-0aebed629c76" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Creating volume 0944dc18-3569-43db-980d-0aebed629c76 from snapshot 2e8038b7-138b-4fbb-af13-98fd05e35d87 {{(pid=86910) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-quobyte-0944dc18-3569-43db-980d-0aebed629c76" by "_copy_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-1acaaa2c-f061-4171-82ee-044cefa15dc4 req-efc206db-c3a6-4a17-8138-bc47a03b2ab9 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-bdc7c04f-cd2a-484b-b251-32553978a89b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11b836c7-367c-47dc-b516-ef8407cc68a5', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-0944dc18-3569-43db-980d-0aebed629c76" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] snapshot: 2e8038b7-138b-4fbb-af13-98fd05e35d87, volume: 0944dc18-3569-43db-980d-0aebed629c76, {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47315eb-0924-469e-98e1-d920e93df83b]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:35 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-1acaaa2c-f061-4171-82ee-044cefa15dc4 req-efc206db-c3a6-4a17-8138-bc47a03b2ab9 tempest-TestServerVolumeAttachmentScenario-1881965009 None] attachment_update completed successfully. Jun 02 00:46:35 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-6f0db0a9-4bff-4d5d-b55f-f263fd50efba" returned: 0 in 0.682s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-quobyte-6f0db0a9-4bff-4d5d-b55f-f263fd50efba" released by "delete_volume" :: held 1.502s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] Created reservations ['711934c6-b3af-403c-987e-74eab1d8bd65', 'cd082184-a345-4057-9774-eb8c4ae0e9c2', '98e7475f-7d8c-4ccc-90ef-c8ad279e2a20', '7a035964-37fe-4e73-8b87-146363e7a988'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:46:35 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87 Jun 02 00:46:35 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:35 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:46:35 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:36 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.663s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:36 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:46:36 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] Deleted volume successfully. Jun 02 00:46:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "cinder-67fe5c2e-e609-4fc4-aa4d-f357345773e0-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1a5260b1-8d5a-457c-8b40-41fb4f06c93c tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-6f0db0a9-4bff-4d5d-b55f-f263fd50efba-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-67fe5c2e-e609-4fc4-aa4d-f357345773e0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:36 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87" returned: 0 in 0.896s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:36 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e955cce8-da4d-4fed-a695-5f8192a75d9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:46:36 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 00:46:36 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Creating direct copy from snapshot {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 00:46:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "cinder-quobyte-67fe5c2e-e609-4fc4-aa4d-f357345773e0" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:36 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8accd01a-01a5-47dc-9fd4-7574328ac850]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-quobyte-67fe5c2e-e609-4fc4-aa4d-f357345773e0" acquired by "delete_volume" :: waited 0.029s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:36 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[93564601-2ee2-4b19-a908-b64bb1052b39]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-67fe5c2e-e609-4fc4-aa4d-f357345773e0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:36 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f Jun 02 00:46:36 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:36 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-67fe5c2e-e609-4fc4-aa4d-f357345773e0 Jun 02 00:46:36 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:37 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f" returned: 0 in 0.882s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:37 devstack cinder-volume[86910]: DEBUG cinder.utils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Path /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0944dc18-3569-43db-980d-0aebed629c76 not found in is_blk_device check {{(pid=86910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 00:46:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0944dc18-3569-43db-980d-0aebed629c76 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:37 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-67fe5c2e-e609-4fc4-aa4d-f357345773e0" returned: 0 in 0.861s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-67fe5c2e-e609-4fc4-aa4d-f357345773e0 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:37 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0944dc18-3569-43db-980d-0aebed629c76 Jun 02 00:46:37 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:37 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-67fe5c2e-e609-4fc4-aa4d-f357345773e0 Jun 02 00:46:37 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:38 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-67fe5c2e-e609-4fc4-aa4d-f357345773e0" returned: 0 in 0.718s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-quobyte-67fe5c2e-e609-4fc4-aa4d-f357345773e0" released by "delete_volume" :: held 1.635s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:38 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Created reservations ['53179345-cdfc-4ffa-9f17-df24b9bdd7d4', 'f6baf252-46c3-4d08-a3c7-c0a011c0424f', 'dd99a325-5379-48e2-b911-3d11055976a4', '7f4f7a84-0362-4770-8dcc-846d3cc3d4e0'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:46:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:38 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:38 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:38 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:46:38 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "cinder-76855a3e-8418-4c97-8358-c032286f5a68-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-76855a3e-8418-4c97-8358-c032286f5a68-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "cinder-quobyte-76855a3e-8418-4c97-8358-c032286f5a68" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-quobyte-76855a3e-8418-4c97-8358-c032286f5a68" acquired by "delete_volume" :: waited 0.047s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:39 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23dfe12-0cca-43b7-8041-cf289721b3ca]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76855a3e-8418-4c97-8358-c032286f5a68 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:40 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76855a3e-8418-4c97-8358-c032286f5a68 Jun 02 00:46:40 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:40 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.866s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:40 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:46:40 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Deleted volume successfully. Jun 02 00:46:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-76344aef-4d59-453e-ab2b-56e241ffbfa8 tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-67fe5c2e-e609-4fc4-aa4d-f357345773e0-delete_volume" released by "delete_volume" :: held 3.795s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:42 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76855a3e-8418-4c97-8358-c032286f5a68" returned: 0 in 2.559s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76855a3e-8418-4c97-8358-c032286f5a68 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:42 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76855a3e-8418-4c97-8358-c032286f5a68 Jun 02 00:46:42 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76855a3e-8418-4c97-8358-c032286f5a68" returned: 0 in 1.812s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:43 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:43 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-quobyte-76855a3e-8418-4c97-8358-c032286f5a68" released by "delete_volume" :: held 4.503s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Created reservations ['02efa074-9fde-4998-9646-de57ec54a7ad', '56ec10fc-c62c-47e1-a5a4-2b50e38a0b56', 'a58f0713-8860-439b-8c60-e30d6098bf62', '5dfe50c9-2a18-4974-bced-121d657484ab'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:44 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:46:44 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "cinder-909b11e5-25bf-46ea-8944-58f1b7fbb8b3-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-909b11e5-25bf-46ea-8944-58f1b7fbb8b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "cinder-quobyte-7b1cb548-0ad2-41eb-a616-c3a13847b99c" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-quobyte-7b1cb548-0ad2-41eb-a616-c3a13847b99c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "cinder-quobyte-909b11e5-25bf-46ea-8944-58f1b7fbb8b3" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-quobyte-909b11e5-25bf-46ea-8944-58f1b7fbb8b3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Deleting offline snapshot 909b11e5-25bf-46ea-8944-58f1b7fbb8b3 of volume 7b1cb548-0ad2-41eb-a616-c3a13847b99c {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:46:44 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] snapshot_file for this snap is: volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0944dc18-3569-43db-980d-0aebed629c76" returned: 0 in 6.914s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9405a073-a605-4487-8f43-f5f6d08e6250]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0090f5e2-0770-4765-a16b-c5ce0bb0caca]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:44 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3 Jun 02 00:46:44 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:44 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f Jun 02 00:46:44 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:44 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.791s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:46:44 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Deleted volume successfully. Jun 02 00:46:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1944ae5f-3130-411c-b291-62ce9b029b6e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-76855a3e-8418-4c97-8358-c032286f5a68-delete_volume" released by "delete_volume" :: held 5.811s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:45 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3" returned: 0 in 0.790s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:46:45 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[549ed3eb-f220-4aa8-ac98-c44c986cd7fc]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:45 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c Jun 02 00:46:45 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:45 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f" returned: 0 in 1.156s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:45 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Image conversion details: src /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f, size 1024.00 MB, duration 6.92 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0944dc18-3569-43db-980d-0aebed629c76 {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:46:45 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Converted 1024.00 MB image at 148.05 MB/s Jun 02 00:46:45 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0944dc18-3569-43db-980d-0aebed629c76 is being set with open permissions: ugo+rw Jun 02 00:46:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0944dc18-3569-43db-980d-0aebed629c76 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:45 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0944dc18-3569-43db-980d-0aebed629c76 Jun 02 00:46:45 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:46 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c" returned: 0 in 0.813s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:46 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3 Jun 02 00:46:46 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0944dc18-3569-43db-980d-0aebed629c76" returned: 0 in 0.642s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-0944dc18-3569-43db-980d-0aebed629c76" released by "_copy_volume_from_snapshot" :: held 10.626s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:46 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-2e8038b7-138b-4fbb-af13-98fd05e35d87-0944dc18-3569-43db-980d-0aebed629c76" released by "_create_volume_from_snapshot" :: held 10.675s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.697s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c784a1-1c9e-4635-a46c-48ae3d36c915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0944dc18-3569-43db-980d-0aebed629c76', 'volume_size': 1, 'snapshot_id': '2e8038b7-138b-4fbb-af13-98fd05e35d87'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd30932-90ec-4a2d-bdc3-586bf4c9990e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:46 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Volume volume-0944dc18-3569-43db-980d-0aebed629c76 (0944dc18-3569-43db-980d-0aebed629c76): created successfully Jun 02 00:46:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd30932-90ec-4a2d-bdc3-586bf4c9990e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Flow 'volume_create_manager' (e5731305-e215-4ef2-9c14-d1f46db2ea6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:46 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-50430ae7-8d97-40f3-8a66-228492469d55 tempest-VolumesSnapshotTestJSON-1559731239 None] Created volume successfully. Jun 02 00:46:46 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3" returned: 0 in 0.704s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:46 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3 Jun 02 00:46:46 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-0944dc18-3569-43db-980d-0aebed629c76-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-0944dc18-3569-43db-980d-0aebed629c76-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-quobyte-0944dc18-3569-43db-980d-0aebed629c76" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-0944dc18-3569-43db-980d-0aebed629c76" acquired by "delete_volume" :: waited 0.014s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:47 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c18bc5-7ae3-4520-adcb-2269838cd1dd]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0944dc18-3569-43db-980d-0aebed629c76 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:47 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0944dc18-3569-43db-980d-0aebed629c76 Jun 02 00:46:47 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:47 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c.909b11e5-25bf-46ea-8944-58f1b7fbb8b3" returned: 0 in 0.796s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-quobyte-909b11e5-25bf-46ea-8944-58f1b7fbb8b3" released by "_delete_snapshot" :: held 3.275s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-quobyte-7b1cb548-0ad2-41eb-a616-c3a13847b99c" released by "delete_snapshot" :: held 3.301s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:47 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Created reservations ['c256ad6f-93d7-4559-9e28-2b0e767bd02a', '2f6edb64-75fa-4a64-bfb0-c203f0b0153b', '384e25a0-bd44-4225-9c6f-895bd48933c0', '866d11cf-d261-47fd-b13b-d404716a68b6'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:46:47 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Delete snapshot completed successfully. Jun 02 00:46:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-604c55fb-88ef-412e-94d3-b13c01928a2e tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-909b11e5-25bf-46ea-8944-58f1b7fbb8b3-delete_snapshot" released by "delete_snapshot" :: held 3.593s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:48 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0944dc18-3569-43db-980d-0aebed629c76" returned: 0 in 1.294s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0944dc18-3569-43db-980d-0aebed629c76 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:48 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0944dc18-3569-43db-980d-0aebed629c76 Jun 02 00:46:48 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:48 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "cinder-7b1cb548-0ad2-41eb-a616-c3a13847b99c-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:48 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-7b1cb548-0ad2-41eb-a616-c3a13847b99c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:48 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "cinder-quobyte-7b1cb548-0ad2-41eb-a616-c3a13847b99c" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:48 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-quobyte-7b1cb548-0ad2-41eb-a616-c3a13847b99c" acquired by "delete_volume" :: waited 0.034s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:48 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d6563f-4dbd-4c60-ab5a-4a125b024be9]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:48 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c Jun 02 00:46:48 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:49 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-0944dc18-3569-43db-980d-0aebed629c76" returned: 0 in 0.729s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:49 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-0944dc18-3569-43db-980d-0aebed629c76" released by "delete_volume" :: held 2.095s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:49 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] Created reservations ['dbb4a7bc-5e08-4aae-bb56-d569668eccf3', '02f77ae9-77df-4913-b769-80700c769d5f', '75f0a02d-1fa9-48d2-bdc8-3d71dcd1cf39', 'd06bd375-4827-4f6c-899e-1e7d4385a83a'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:46:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:49 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:46:49 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-cdce6a91-de89-40e7-96a1-059f0e8427fa req-6cd18827-353c-4e4f-a01b-14c48aa834c9 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-cdce6a91-de89-40e7-96a1-059f0e8427fa req-6cd18827-353c-4e4f-a01b-14c48aa834c9 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:49 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[284c1da6-b026-4360-9d6b-e6dc1d53f530]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-cdce6a91-de89-40e7-96a1-059f0e8427fa req-6cd18827-353c-4e4f-a01b-14c48aa834c9 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-572cbde4-dd7a-4b1e-9370-1940be12b705 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:49 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c" returned: 0 in 1.152s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:50 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c Jun 02 00:46:50 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:50 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-572cbde4-dd7a-4b1e-9370-1940be12b705 Jun 02 00:46:50 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:50 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.061s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:50 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:46:50 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] Deleted volume successfully. Jun 02 00:46:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-19940606-1ed7-4791-9c84-29f637d83e83 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-0944dc18-3569-43db-980d-0aebed629c76-delete_volume" released by "delete_volume" :: held 3.471s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-2e8038b7-138b-4fbb-af13-98fd05e35d87-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-2e8038b7-138b-4fbb-af13-98fd05e35d87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-quobyte-e955cce8-da4d-4fed-a695-5f8192a75d9f" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-e955cce8-da4d-4fed-a695-5f8192a75d9f" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-quobyte-2e8038b7-138b-4fbb-af13-98fd05e35d87" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-2e8038b7-138b-4fbb-af13-98fd05e35d87" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] Deleting offline snapshot 2e8038b7-138b-4fbb-af13-98fd05e35d87 of volume e955cce8-da4d-4fed-a695-5f8192a75d9f {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:46:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] snapshot_file for this snap is: volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:46:50 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d121ccd-fc58-4887-8dda-49d50213e14e]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:50 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-cdce6a91-de89-40e7-96a1-059f0e8427fa req-6cd18827-353c-4e4f-a01b-14c48aa834c9 tempest-TestServerVolumeAttachmentScenario-1881965009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-572cbde4-dd7a-4b1e-9370-1940be12b705" returned: 0 in 0.966s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-cdce6a91-de89-40e7-96a1-059f0e8427fa req-6cd18827-353c-4e4f-a01b-14c48aa834c9 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-cdce6a91-de89-40e7-96a1-059f0e8427fa req-6cd18827-353c-4e4f-a01b-14c48aa834c9 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-572cbde4-dd7a-4b1e-9370-1940be12b705', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '662b3cb1-13f9-49d5-a95b-e05010280675', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:46:50 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b1cb548-0ad2-41eb-a616-c3a13847b99c" returned: 0 in 1.001s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:50 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87 Jun 02 00:46:50 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:51 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-quobyte-7b1cb548-0ad2-41eb-a616-c3a13847b99c" released by "delete_volume" :: held 2.269s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:51 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-cdce6a91-de89-40e7-96a1-059f0e8427fa req-6cd18827-353c-4e4f-a01b-14c48aa834c9 tempest-TestServerVolumeAttachmentScenario-1881965009 None] attachment_update completed successfully. Jun 02 00:46:51 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] Created reservations ['f3667a86-e77c-4761-8c63-52a51c2de943', 'ab056ea4-a4cb-4527-8b20-c2f62695b535', 'c36ef03f-65b7-4c72-8c2a-fc98d2c27140', '494c58ff-d28d-4c8e-b09f-7adb46a31a3b'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:46:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:51 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:46:51 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:51 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87" returned: 0 in 1.093s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e955cce8-da4d-4fed-a695-5f8192a75d9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:46:51 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edbe49a-bbb7-42d6-90e5-982e0e603c7d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:51 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.772s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:51 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:46:51 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] Deleted volume successfully. Jun 02 00:46:51 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f Jun 02 00:46:51 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:52 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4ac06dfc-2ab0-4626-bdd1-86415b552fbb tempest-CreateVolumesFromSnapshotTest-1313124232 None] Lock "cinder-7b1cb548-0ad2-41eb-a616-c3a13847b99c-delete_volume" released by "delete_volume" :: held 3.371s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:52 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f" returned: 0 in 1.012s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:52 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87 Jun 02 00:46:52 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:53 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87" returned: 0 in 1.092s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:53 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87 Jun 02 00:46:53 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:54 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f.2e8038b7-138b-4fbb-af13-98fd05e35d87" returned: 0 in 0.696s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:54 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-2e8038b7-138b-4fbb-af13-98fd05e35d87" released by "_delete_snapshot" :: held 4.038s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:54 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-e955cce8-da4d-4fed-a695-5f8192a75d9f" released by "delete_snapshot" :: held 4.092s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:54 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] Created reservations ['20900409-05b3-4bfb-b76d-df42dae8ebcc', '087752e7-a0b5-4f77-a1ca-4599e1ad8b9a', 'c0591b49-8806-48bc-80c4-e899d821c51e', 'cee40458-6d21-41aa-8d55-40cb301371d7'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:46:54 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] Delete snapshot completed successfully. Jun 02 00:46:54 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c17758f2-db4f-4604-8ef8-d5dddcc01b89 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-2e8038b7-138b-4fbb-af13-98fd05e35d87-delete_snapshot" released by "delete_snapshot" :: held 4.381s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:55 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-e955cce8-da4d-4fed-a695-5f8192a75d9f-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:55 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-e955cce8-da4d-4fed-a695-5f8192a75d9f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:55 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-quobyte-e955cce8-da4d-4fed-a695-5f8192a75d9f" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:55 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-e955cce8-da4d-4fed-a695-5f8192a75d9f" acquired by "delete_volume" :: waited 0.020s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:55 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78671d6-0fac-4dbe-88ce-2d1f6f5a449c]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:55 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f Jun 02 00:46:55 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:55 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f" returned: 0 in 0.766s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:56 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f Jun 02 00:46:56 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Flow 'volume_create_manager' (87846096-5f86-4e2e-91b2-9e4ce5388ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f31897a-2a48-4906-986f-b7a8c9892ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f31897a-2a48-4906-986f-b7a8c9892ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1545790386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5891a2-f86a-4464-9dbf-b440a2f4948a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8b8ebc0ffc4990bc3719a00538e0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:56Z,use_quota=True,user_id='d9a7394ee48542b68436121fa8deb93f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7dfa15c-7422-4dec-8bde-c3ebecca4c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7dfa15c-7422-4dec-8bde-c3ebecca4c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108d31fa-f1bf-456b-a051-b4aae252ad97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108d31fa-f1bf-456b-a051-b4aae252ad97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d5891a2-f86a-4464-9dbf-b440a2f4948a', 'volume_name': 'volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af3c868-61b1-469a-aa66-a27cb43595c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af3c868-61b1-469a-aa66-a27cb43595c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0679b42a-19a8-4b48-9cd1-23f90f09d506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:56 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Volume 5d5891a2-f86a-4464-9dbf-b440a2f4948a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a', 'volume_size': 1} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1545790386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5891a2-f86a-4464-9dbf-b440a2f4948a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8b8ebc0ffc4990bc3719a00538e0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:46:56Z,use_quota=True,user_id='d9a7394ee48542b68436121fa8deb93f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Creating volume 5d5891a2-f86a-4464-9dbf-b440a2f4948a {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:46:56 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:56 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a 1073741824 Jun 02 00:46:56 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:56 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e955cce8-da4d-4fed-a695-5f8192a75d9f" returned: 0 in 0.673s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-e955cce8-da4d-4fed-a695-5f8192a75d9f" released by "delete_volume" :: held 1.519s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Created reservations ['21a72fd3-d1f1-4c96-99b9-08e3aec1cd56', '3405ed4b-e99d-4914-8651-ea5c13c0ab42', 'b8ee70bd-1f9f-46a1-afad-eb93f6b61ef7', 'fe2c6ce0-4099-464e-9d04-480212fa8f23'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:56 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:46:56 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:57 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a 1073741824" returned: 0 in 0.877s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:57 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a Jun 02 00:46:57 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-f77849ef-960d-4eca-8378-d27b728e7af5-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-f77849ef-960d-4eca-8378-d27b728e7af5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "cinder-quobyte-f77849ef-960d-4eca-8378-d27b728e7af5" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-f77849ef-960d-4eca-8378-d27b728e7af5" acquired by "delete_volume" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:46:57 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.708s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:46:57 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Deleted volume successfully. Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3217b469-8429-465d-be00-2f8b80501a9c]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-98539aac-a64c-485d-b48a-4b2a359c4d9f tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-e955cce8-da4d-4fed-a695-5f8192a75d9f-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:57 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5 Jun 02 00:46:57 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:57 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-adc966f0-c791-473e-bbb0-7f3f7aa23b07 req-7d9314ae-51cc-4034-a084-1c4fbc1f14c5 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Terminate volume connection completed successfully. Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-adc966f0-c791-473e-bbb0-7f3f7aa23b07 req-7d9314ae-51cc-4034-a084-1c4fbc1f14c5 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Deleting attachment 662b3cb1-13f9-49d5-a95b-e05010280675. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:46:57 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a" returned: 0 in 0.717s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0679b42a-19a8-4b48-9cd1-23f90f09d506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8d6324-786e-4879-b6b2-193fb64c9513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:46:57 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Volume volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a (5d5891a2-f86a-4464-9dbf-b440a2f4948a): created successfully Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8d6324-786e-4879-b6b2-193fb64c9513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:46:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Flow 'volume_create_manager' (87846096-5f86-4e2e-91b2-9e4ce5388ab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:46:57 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f9404bff-c872-4d4f-955f-aa19fedf6fdc tempest-VolumeDependencyTests-159439257 None] Created volume successfully. Jun 02 00:46:58 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5" returned: 0 in 0.739s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:58 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5 Jun 02 00:46:58 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] Creating offline snapshot 5f978168-6092-4718-84a0-98777a691b08 of volume 5d5891a2-f86a-4464-9dbf-b440a2f4948a {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:46:58 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[990dfc19-4d03-435a-806c-49611d16b85a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:46:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:58 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a Jun 02 00:46:58 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:58 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f77849ef-960d-4eca-8378-d27b728e7af5" returned: 0 in 0.643s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:58 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-quobyte-f77849ef-960d-4eca-8378-d27b728e7af5" released by "delete_volume" :: held 1.454s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:46:58 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] Created reservations ['224314fa-79f4-4b5a-8d47-77e375d5c031', 'a0fd7e61-3efe-4808-999c-42ed5501d9cf', 'c5876d89-9e1a-45de-9a1b-0dd688be7b82', '55410d5a-d04c-4bdb-9391-0a358c24ec54'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:46:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:46:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:46:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:46:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:46:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:46:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:59 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:46:59 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:59 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a" returned: 0 in 0.769s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:46:59 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08 1G Jun 02 00:46:59 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:46:59 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Jun 02 00:46:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.680s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:46:59 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:46:59 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] Deleted volume successfully. Jun 02 00:46:59 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3ba12b31-cb71-4887-a674-c39b78ae79a2 tempest-VolumesSnapshotTestJSON-1559731239 None] Lock "cinder-f77849ef-960d-4eca-8378-d27b728e7af5-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:00 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08 1G" returned: 0 in 0.965s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:00 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08 Jun 02 00:47:00 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:00 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08" returned: 0 in 0.714s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:00 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08 is being set with open permissions: ugo+rw Jun 02 00:47:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:00 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08 Jun 02 00:47:00 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:01 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08" returned: 0 in 0.661s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:01 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.info Jun 02 00:47:01 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:01 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-1e21dd83-73e4-4d0d-874d-7120ee723215 req-162f79c5-8754-421c-951d-1af56d02b689 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Terminate volume connection completed successfully. Jun 02 00:47:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-1e21dd83-73e4-4d0d-874d-7120ee723215 req-162f79c5-8754-421c-951d-1af56d02b689 tempest-TestServerVolumeAttachmentScenario-1881965009 None] Deleting attachment 11b836c7-367c-47dc-b516-ef8407cc68a5. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:47:02 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.info" returned: 0 in 0.805s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:02 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.info is being set with open permissions: ugo+rw Jun 02 00:47:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:02 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.info Jun 02 00:47:02 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:03 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.info" returned: 0 in 0.782s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.799s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:03 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-330436ab-6007-4a93-b495-c0d0754a8a98 tempest-VolumeDependencyTests-159439257 None] Create snapshot completed successfully Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Flow 'volume_create_manager' (6ce9b713-c626-4a96-a20b-554cd0a4e3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b1174f-f075-4a40-bf8a-0dbac4597018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b1174f-f075-4a40-bf8a-0dbac4597018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-263717913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2133ad91-7f16-410a-a561-6e641e920552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8b8ebc0ffc4990bc3719a00538e0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5f978168-6092-4718-84a0-98777a691b08,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:04Z,use_quota=True,user_id='d9a7394ee48542b68436121fa8deb93f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0c1fa1-84b2-4b7b-9c8f-cd00d6f375c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0c1fa1-84b2-4b7b-9c8f-cd00d6f375c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f6dc7a-2a29-4f96-b03d-a3ca1ebcb746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f6dc7a-2a29-4f96-b03d-a3ca1ebcb746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2133ad91-7f16-410a-a561-6e641e920552', 'volume_name': 'volume-2133ad91-7f16-410a-a561-6e641e920552', 'volume_size': 1, 'snapshot_id': '5f978168-6092-4718-84a0-98777a691b08'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735b347a-e5b4-435b-87f2-1555e4ba8d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735b347a-e5b4-435b-87f2-1555e4ba8d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385d9119-f95e-442c-b899-e8f000590d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:04 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Volume 2133ad91-7f16-410a-a561-6e641e920552: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2133ad91-7f16-410a-a561-6e641e920552', 'volume_size': 1, 'snapshot_id': '5f978168-6092-4718-84a0-98777a691b08'} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Acquiring lock "cinder-quobyte-5f978168-6092-4718-84a0-98777a691b08-2133ad91-7f16-410a-a561-6e641e920552" by "_create_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Lock "cinder-quobyte-5f978168-6092-4718-84a0-98777a691b08-2133ad91-7f16-410a-a561-6e641e920552" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Creating volume 2133ad91-7f16-410a-a561-6e641e920552 from snapshot 5f978168-6092-4718-84a0-98777a691b08 {{(pid=86910) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Acquiring lock "cinder-quobyte-2133ad91-7f16-410a-a561-6e641e920552" by "_copy_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Lock "cinder-quobyte-2133ad91-7f16-410a-a561-6e641e920552" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] snapshot: 5f978168-6092-4718-84a0-98777a691b08, volume: 2133ad91-7f16-410a-a561-6e641e920552, {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dd7333-84d1-40d5-9cea-189435bc4fd9]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:04 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08 Jun 02 00:47:04 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:05 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08" returned: 0 in 1.038s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:47:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 00:47:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Creating direct copy from snapshot {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 00:47:05 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[368a397d-4db3-429c-8d72-71b29f714463]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:05 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a Jun 02 00:47:05 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:06 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a" returned: 0 in 0.906s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:06 devstack cinder-volume[86910]: DEBUG cinder.utils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Path /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2133ad91-7f16-410a-a561-6e641e920552 not found in is_blk_device check {{(pid=86910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 00:47:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2133ad91-7f16-410a-a561-6e641e920552 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:06 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2133ad91-7f16-410a-a561-6e641e920552 Jun 02 00:47:06 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:06 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] Acquiring lock "cinder-41551ac9-b492-4720-a7c8-90fc4d54c09d-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:06 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] Lock "cinder-41551ac9-b492-4720-a7c8-90fc4d54c09d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:06 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] Acquiring lock "cinder-quobyte-41551ac9-b492-4720-a7c8-90fc4d54c09d" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:06 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] Lock "cinder-quobyte-41551ac9-b492-4720-a7c8-90fc4d54c09d" acquired by "delete_volume" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:06 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be5359c-69de-4974-b55c-4b1413c115df]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-41551ac9-b492-4720-a7c8-90fc4d54c09d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:07 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-41551ac9-b492-4720-a7c8-90fc4d54c09d Jun 02 00:47:07 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:08 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-41551ac9-b492-4720-a7c8-90fc4d54c09d" returned: 0 in 1.505s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-41551ac9-b492-4720-a7c8-90fc4d54c09d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:08 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-41551ac9-b492-4720-a7c8-90fc4d54c09d Jun 02 00:47:08 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:10 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-41551ac9-b492-4720-a7c8-90fc4d54c09d" returned: 0 in 1.919s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] Lock "cinder-quobyte-41551ac9-b492-4720-a7c8-90fc4d54c09d" released by "delete_volume" :: held 3.494s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:10 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] Created reservations ['4d2a5c0f-6e1e-4679-ba39-c0ceb3809b47', 'e993bf48-d0a2-4bc7-9a86-b37f593b0745', '4cfa44d5-c76c-4150-8851-63f4c69d1762', '4f3d2b32-8b61-4f81-942f-2e01d123845c'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:47:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:10 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:47:10 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:12 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.563s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:12 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:47:12 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] Deleted volume successfully. Jun 02 00:47:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-4a9ab089-6fab-414a-9704-f3635f8c8f22 tempest-VolumesNegativeTest-374594760 None] Lock "cinder-41551ac9-b492-4720-a7c8-90fc4d54c09d-delete_volume" released by "delete_volume" :: held 5.520s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:13 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2133ad91-7f16-410a-a561-6e641e920552" returned: 0 in 6.416s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:13 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22835a8-9720-4e8f-abd3-084a36b3b146]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:13 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a Jun 02 00:47:13 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] Acquiring lock "cinder-572cbde4-dd7a-4b1e-9370-1940be12b705-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "cinder-572cbde4-dd7a-4b1e-9370-1940be12b705-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] Acquiring lock "cinder-quobyte-572cbde4-dd7a-4b1e-9370-1940be12b705" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "cinder-quobyte-572cbde4-dd7a-4b1e-9370-1940be12b705" acquired by "delete_volume" :: waited 0.016s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:14 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae17a90e-4425-49b2-87a1-2b2f2a112f42]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-572cbde4-dd7a-4b1e-9370-1940be12b705 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:14 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-572cbde4-dd7a-4b1e-9370-1940be12b705 Jun 02 00:47:14 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:14 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a" returned: 0 in 1.224s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:14 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Image conversion details: src /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a, size 1024.00 MB, duration 6.42 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2133ad91-7f16-410a-a561-6e641e920552 {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:47:14 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Converted 1024.00 MB image at 159.58 MB/s Jun 02 00:47:14 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2133ad91-7f16-410a-a561-6e641e920552 is being set with open permissions: ugo+rw Jun 02 00:47:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2133ad91-7f16-410a-a561-6e641e920552 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:14 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2133ad91-7f16-410a-a561-6e641e920552 Jun 02 00:47:14 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:14 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:47:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Flow 'volume_create_manager' (15d22c15-4a5a-4908-8e3b-3de0822dcd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:47:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005e069b-b6db-4f4b-b240-dfae57454767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005e069b-b6db-4f4b-b240-dfae57454767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e036cb2-9858-4d1c-8a84-3bf745cb6d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768cc1c0aba34e45842d0d832f5f80dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:15Z,use_quota=True,user_id='0e8f49768f4f42b990db76babacc708e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3981f67f-0042-4eb9-9b5e-39dbd0cc4175),volume_type_id=3981f67f-0042-4eb9-9b5e-39dbd0cc4175)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8dc21e-fcd3-4265-b541-c51d0fb0b723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8dc21e-fcd3-4265-b541-c51d0fb0b723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:14 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfadf858-1619-4726-a523-6f481c6dc399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:14 devstack cinder-volume[86910]: DEBUG cinder.image.glance [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Creating Keystone auth plugin from conf {{(pid=86910) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 00:47:15 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-572cbde4-dd7a-4b1e-9370-1940be12b705" returned: 0 in 0.886s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-572cbde4-dd7a-4b1e-9370-1940be12b705 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:15 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-572cbde4-dd7a-4b1e-9370-1940be12b705 Jun 02 00:47:15 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:15 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2133ad91-7f16-410a-a561-6e641e920552" returned: 0 in 0.780s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Lock "cinder-quobyte-2133ad91-7f16-410a-a561-6e641e920552" released by "_copy_volume_from_snapshot" :: held 10.528s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Lock "cinder-quobyte-5f978168-6092-4718-84a0-98777a691b08-2133ad91-7f16-410a-a561-6e641e920552" released by "_create_volume_from_snapshot" :: held 10.575s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.592s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:15 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:47:15 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385d9119-f95e-442c-b899-e8f000590d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2133ad91-7f16-410a-a561-6e641e920552', 'volume_size': 1, 'snapshot_id': '5f978168-6092-4718-84a0-98777a691b08'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249e3512-72a9-40e0-99d8-7f4aeae7e588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:15 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Volume volume-2133ad91-7f16-410a-a561-6e641e920552 (2133ad91-7f16-410a-a561-6e641e920552): created successfully Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249e3512-72a9-40e0-99d8-7f4aeae7e588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Flow 'volume_create_manager' (6ce9b713-c626-4a96-a20b-554cd0a4e3fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfadf858-1619-4726-a523-6f481c6dc399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7e036cb2-9858-4d1c-8a84-3bf745cb6d85', 'volume_name': 'volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85', 'volume_size': 1, 'image_id': '4affb77d-59a5-4e59-bf40-c2324655cf98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4affb77d-59a5-4e59-bf40-c2324655cf98', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '127bc9834e0e127b152b673d4922b035', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '768cc1c0aba34e45842d0d832f5f80dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db7f17b24e0cc8d72ceeea62cc7292c5213e9453cc46d683480a81c79cf08525ccb1ee7e6293fa9ff0daddce76027383b5580f8dde1cb04c4ee03c5b72bcdcf0', 'id': '4affb77d-59a5-4e59-bf40-c2324655cf98', 'created_at': datetime.datetime(2026, 6, 1, 22, 47, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 47, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4affb77d-59a5-4e59-bf40-c2324655cf98/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce4f065-78ec-4663-b4d1-e245c957228d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce4f065-78ec-4663-b4d1-e245c957228d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adad960f-7167-4b84-a998-4386c406c6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:15 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Volume 7e036cb2-9858-4d1c-8a84-3bf745cb6d85: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85', 'volume_size': 1, 'image_id': '4affb77d-59a5-4e59-bf40-c2324655cf98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4affb77d-59a5-4e59-bf40-c2324655cf98', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '127bc9834e0e127b152b673d4922b035', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '768cc1c0aba34e45842d0d832f5f80dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db7f17b24e0cc8d72ceeea62cc7292c5213e9453cc46d683480a81c79cf08525ccb1ee7e6293fa9ff0daddce76027383b5580f8dde1cb04c4ee03c5b72bcdcf0', 'id': '4affb77d-59a5-4e59-bf40-c2324655cf98', 'created_at': datetime.datetime(2026, 6, 1, 22, 47, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 47, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4affb77d-59a5-4e59-bf40-c2324655cf98/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Trying to clone 7e036cb2-9858-4d1c-8a84-3bf745cb6d85 from image 4affb77d-59a5-4e59-bf40-c2324655cf98 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4affb77d-59a5-4e59-bf40-c2324655cf98', 'metadata': {}}]). {{(pid=86910) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 00:47:15 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-51b37ebc-075b-4ee0-b1b7-551503f500aa tempest-VolumeDependencyTests-159439257 None] Created volume successfully. Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 00:47:15 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Image download 0.00 MB at 0.00 MB/s Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4fc7a0-6f57-4da0-bedc-f3256adf9ca2]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] Acquiring lock "cinder-5f978168-6092-4718-84a0-98777a691b08-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] Lock "cinder-5f978168-6092-4718-84a0-98777a691b08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] Acquiring lock "cinder-quobyte-5d5891a2-f86a-4464-9dbf-b440a2f4948a" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] Lock "cinder-quobyte-5d5891a2-f86a-4464-9dbf-b440a2f4948a" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] Acquiring lock "cinder-quobyte-5f978168-6092-4718-84a0-98777a691b08" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] Lock "cinder-quobyte-5f978168-6092-4718-84a0-98777a691b08" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] Deleting offline snapshot 5f978168-6092-4718-84a0-98777a691b08 of volume 5d5891a2-f86a-4464-9dbf-b440a2f4948a {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:47:15 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD Jun 02 00:47:15 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] snapshot_file for this snap is: volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[db86ab22-0044-43a1-9988-4c7641fea9db]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:16 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08 Jun 02 00:47:16 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:16 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-572cbde4-dd7a-4b1e-9370-1940be12b705" returned: 0 in 0.960s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "cinder-quobyte-572cbde4-dd7a-4b1e-9370-1940be12b705" released by "delete_volume" :: held 1.901s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:16 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.900s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] Created reservations ['af13d7ac-e93b-4932-88fe-b2488fc1db99', '706ef36e-557b-4958-bb65-465bc2fa2c8e', '9064b620-3eaa-495e-a4b0-3b2f5d2a0614', '7298ab0f-c541-4bfb-a31f-79e29e66d831'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:16 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:47:16 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] Acquiring lock "cinder-bdc7c04f-cd2a-484b-b251-32553978a89b-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "cinder-bdc7c04f-cd2a-484b-b251-32553978a89b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] Acquiring lock "cinder-quobyte-bdc7c04f-cd2a-484b-b251-32553978a89b" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:16 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD" returned: 0 in 0.891s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "cinder-quobyte-bdc7c04f-cd2a-484b-b251-32553978a89b" acquired by "delete_volume" :: waited 0.042s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4741dc7-7085-4e20-9c7e-112d5ea46aa9]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bdc7c04f-cd2a-484b-b251-32553978a89b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:16 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD Jun 02 00:47:16 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:16 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bdc7c04f-cd2a-484b-b251-32553978a89b Jun 02 00:47:16 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:17 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08" returned: 0 in 1.178s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:17 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:47:17 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a99a43-b8e2-4579-8152-6184ab96d186]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:17 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a Jun 02 00:47:17 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:17 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.030s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:17 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:47:17 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] Deleted volume successfully. Jun 02 00:47:17 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c8a6794f-1978-4c96-8675-60f5d1b3b7bf tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "cinder-572cbde4-dd7a-4b1e-9370-1940be12b705-delete_volume" released by "delete_volume" :: held 3.270s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:17 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD" returned: 1 in 0.887s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:47:17 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Temporary image 4affb77d-59a5-4e59-bf40-c2324655cf98 is fetched for user 0e8f49768f4f42b990db76babacc708e. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 00:47:17 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d780f9cf-eb49-4912-addc-260ef07dff0a]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:17 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD Jun 02 00:47:17 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:17 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bdc7c04f-cd2a-484b-b251-32553978a89b" returned: 0 in 1.121s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bdc7c04f-cd2a-484b-b251-32553978a89b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:17 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bdc7c04f-cd2a-484b-b251-32553978a89b Jun 02 00:47:17 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:18 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a" returned: 0 in 0.920s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:18 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08 Jun 02 00:47:18 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:18 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD" returned: 0 in 0.775s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:18 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD Jun 02 00:47:18 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:18 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-bdc7c04f-cd2a-484b-b251-32553978a89b" returned: 0 in 0.700s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:18 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "cinder-quobyte-bdc7c04f-cd2a-484b-b251-32553978a89b" released by "delete_volume" :: held 1.887s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:18 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] Created reservations ['3951592c-b33a-4b7c-b551-f58069757a93', 'e9087e88-f847-445a-be06-ecbb8334543f', 'fc36bcb7-3f56-413f-ac92-ab362452c466', '3c212816-2ef8-4042-8c5a-ac8431d9006c'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:47:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:18 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:47:18 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:18 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08" returned: 0 in 0.894s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:18 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08 Jun 02 00:47:18 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:19 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD" returned: 1 in 0.982s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e036cb2-9858-4d1c-8a84-3bf745cb6d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768cc1c0aba34e45842d0d832f5f80dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:15Z,use_quota=True,user_id='0e8f49768f4f42b990db76babacc708e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3981f67f-0042-4eb9-9b5e-39dbd0cc4175),volume_type_id=3981f67f-0042-4eb9-9b5e-39dbd0cc4175)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Creating volume 7e036cb2-9858-4d1c-8a84-3bf745cb6d85 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:47:19 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:19 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 1073741824 Jun 02 00:47:19 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:19 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.748s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:47:19 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] Deleted volume successfully. Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cb96cc68-97f8-4da5-a5dc-2e26a212be3e tempest-TestServerVolumeAttachmentScenario-1881965009 None] Lock "cinder-bdc7c04f-cd2a-484b-b251-32553978a89b-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:19 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a.5f978168-6092-4718-84a0-98777a691b08" returned: 0 in 0.819s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] Lock "cinder-quobyte-5f978168-6092-4718-84a0-98777a691b08" released by "_delete_snapshot" :: held 3.986s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] Lock "cinder-quobyte-5d5891a2-f86a-4464-9dbf-b440a2f4948a" released by "delete_snapshot" :: held 4.029s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:19 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] Created reservations ['ffab3a38-ef86-4dc2-a9a7-c15ef119bd6e', '2dcafb54-ac4f-41d6-b42e-1d080d184899', '9638eb0d-4cb1-45fa-9bfa-b91badff8a96', 'e036a822-d220-41c8-84c1-8b8c1200b7b2'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:47:20 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] Delete snapshot completed successfully. Jun 02 00:47:20 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6fcbc252-3f83-4202-86fc-88f1bf10e5b6 tempest-VolumeDependencyTests-159439257 None] Lock "cinder-5f978168-6092-4718-84a0-98777a691b08-delete_snapshot" released by "delete_snapshot" :: held 4.273s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:20 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 1073741824" returned: 0 in 1.040s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:20 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 Jun 02 00:47:20 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:21 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85" returned: 0 in 0.632s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:47:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:21 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Attempting download of 4affb77d-59a5-4e59-bf40-c2324655cf98 ((None, [{'url': 'file:///opt/stack/data/glance/images/4affb77d-59a5-4e59-bf40-c2324655cf98', 'metadata': {}}])) to volume 7e036cb2-9858-4d1c-8a84-3bf745cb6d85. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 00:47:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] Acquiring lock "cinder-5d5891a2-f86a-4464-9dbf-b440a2f4948a-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] Lock "cinder-5d5891a2-f86a-4464-9dbf-b440a2f4948a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:21 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8dbd78-3e32-4426-8ab9-48ab31adefeb]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4affb77d-59a5-4e59-bf40-c2324655cf98_w9gd_o2q {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] Acquiring lock "cinder-quobyte-5d5891a2-f86a-4464-9dbf-b440a2f4948a" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] Lock "cinder-quobyte-5d5891a2-f86a-4464-9dbf-b440a2f4948a" acquired by "delete_volume" :: waited 0.039s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:21 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71074d8-4cce-4233-8003-9aa4c65f3fa9]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:21 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4affb77d-59a5-4e59-bf40-c2324655cf98_w9gd_o2q Jun 02 00:47:21 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:21 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a Jun 02 00:47:21 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:22 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4affb77d-59a5-4e59-bf40-c2324655cf98_w9gd_o2q" returned: 0 in 0.971s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4affb77d-59a5-4e59-bf40-c2324655cf98_w9gd_o2q {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:22 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a" returned: 0 in 0.978s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:22 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4affb77d-59a5-4e59-bf40-c2324655cf98_w9gd_o2q Jun 02 00:47:22 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:22 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a Jun 02 00:47:22 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:23 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4affb77d-59a5-4e59-bf40-c2324655cf98_w9gd_o2q" returned: 1 in 0.992s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4affb77d-59a5-4e59-bf40-c2324655cf98_w9gd_o2q' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:47:23 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0070ef-6b4e-491b-a8ee-c5d18c4cfe93]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:23 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5d5891a2-f86a-4464-9dbf-b440a2f4948a" returned: 0 in 0.856s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] Lock "cinder-quobyte-5d5891a2-f86a-4464-9dbf-b440a2f4948a" released by "delete_volume" :: held 1.929s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:23 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD Jun 02 00:47:23 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:23 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] Created reservations ['77dfbf37-4e0c-4666-b970-79c05a8e9f2d', '997d28e4-ecee-46db-9d49-5a18ab9c09da', '2be3393c-fdf4-4a6b-bd65-34f54594009a', 'e741c158-8747-4ef2-9a54-c76726458964'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:47:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:23 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:47:23 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:24 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD" returned: 0 in 0.953s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:24 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD Jun 02 00:47:24 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:24 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.874s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:24 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:47:24 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] Deleted volume successfully. Jun 02 00:47:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-bb289e26-e3ee-42ec-985a-1643d1e3fe9c tempest-VolumeDependencyTests-159439257 None] Lock "cinder-5d5891a2-f86a-4464-9dbf-b440a2f4948a-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] Acquiring lock "cinder-2133ad91-7f16-410a-a561-6e641e920552-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] Lock "cinder-2133ad91-7f16-410a-a561-6e641e920552-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] Acquiring lock "cinder-quobyte-2133ad91-7f16-410a-a561-6e641e920552" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] Lock "cinder-quobyte-2133ad91-7f16-410a-a561-6e641e920552" acquired by "delete_volume" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:24 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd1bbf1-9175-4d2a-9a1a-357792d937c2]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2133ad91-7f16-410a-a561-6e641e920552 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:24 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2133ad91-7f16-410a-a561-6e641e920552 Jun 02 00:47:24 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:25 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD" returned: 1 in 0.962s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:47:25 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] 4affb77d-59a5-4e59-bf40-c2324655cf98 was raw, converting to raw {{(pid=86910) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 00:47:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:25 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 Jun 02 00:47:25 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:25 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2133ad91-7f16-410a-a561-6e641e920552" returned: 0 in 0.824s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2133ad91-7f16-410a-a561-6e641e920552 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:25 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2133ad91-7f16-410a-a561-6e641e920552 Jun 02 00:47:25 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:26 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85" returned: 0 in 0.958s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:26 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4affb77d-59a5-4e59-bf40-c2324655cf98_p60c1s5mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:47:26 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Converted 0.00 MB image at 0.00 MB/s Jun 02 00:47:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:26 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 1G Jun 02 00:47:26 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:26 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2133ad91-7f16-410a-a561-6e641e920552" returned: 0 in 0.786s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] Lock "cinder-quobyte-2133ad91-7f16-410a-a561-6e641e920552" released by "delete_volume" :: held 1.672s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:26 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] Created reservations ['dd4b685f-9205-4c0b-8943-72b4411caa6d', 'eac08cf4-45ca-4d00-b3b7-c997dae8bb7c', '31cfc85a-c0ae-44ac-baa8-a42433143daa', 'b5df1a27-01ef-4116-b8c0-7d41a1520101'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:47:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:26 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:47:26 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:26 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 1G" returned: 0 in 0.888s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:27 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c8c8e8-d9b2-4df3-906d-f8966cd758e4]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:27 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 Jun 02 00:47:27 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:27 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.859s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:27 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:47:27 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] Deleted volume successfully. Jun 02 00:47:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-83540a51-8f7e-405f-a37c-7f40418f11fd tempest-VolumeDependencyTests-159439257 None] Lock "cinder-2133ad91-7f16-410a-a561-6e641e920552-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:28 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85" returned: 0 in 1.217s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:28 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 Jun 02 00:47:28 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:29 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85" returned: 1 in 0.803s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:47:29 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Downloaded image 4affb77d-59a5-4e59-bf40-c2324655cf98 ((None, [{'url': 'file:///opt/stack/data/glance/images/4affb77d-59a5-4e59-bf40-c2324655cf98', 'metadata': {}}])) to volume 7e036cb2-9858-4d1c-8a84-3bf745cb6d85 successfully. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 00:47:29 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Temporary image 4affb77d-59a5-4e59-bf40-c2324655cf98 for user 0e8f49768f4f42b990db76babacc708e is deleted. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 00:47:29 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Marking volume 7e036cb2-9858-4d1c-8a84-3bf745cb6d85 as bootable. {{(pid=86910) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 00:47:29 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=143,cinder:DELETE=15,cinder:SELECT=115,cinder:INSERT=37 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:47:29 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Copying metadata from image 4affb77d-59a5-4e59-bf40-c2324655cf98 to 7e036cb2-9858-4d1c-8a84-3bf745cb6d85. {{(pid=86910) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 00:47:29 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Creating volume glance metadata for volume 7e036cb2-9858-4d1c-8a84-3bf745cb6d85 backed by image 4affb77d-59a5-4e59-bf40-c2324655cf98 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4affb77d-59a5-4e59-bf40-c2324655cf98', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '127bc9834e0e127b152b673d4922b035', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86910) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 00:47:29 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=120,cinder:INSERT=37,cinder:UPDATE=151,cinder:DELETE=6 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:47:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adad960f-7167-4b84-a998-4386c406c6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85', 'volume_size': 1, 'image_id': '4affb77d-59a5-4e59-bf40-c2324655cf98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4affb77d-59a5-4e59-bf40-c2324655cf98', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '127bc9834e0e127b152b673d4922b035', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '768cc1c0aba34e45842d0d832f5f80dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db7f17b24e0cc8d72ceeea62cc7292c5213e9453cc46d683480a81c79cf08525ccb1ee7e6293fa9ff0daddce76027383b5580f8dde1cb04c4ee03c5b72bcdcf0', 'id': '4affb77d-59a5-4e59-bf40-c2324655cf98', 'created_at': datetime.datetime(2026, 6, 1, 22, 47, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 47, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4affb77d-59a5-4e59-bf40-c2324655cf98/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0484e9b6-a43c-40bd-8ed0-e4368804e961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:29 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Volume volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 (7e036cb2-9858-4d1c-8a84-3bf745cb6d85): created successfully Jun 02 00:47:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0484e9b6-a43c-40bd-8ed0-e4368804e961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:29 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Flow 'volume_create_manager' (15d22c15-4a5a-4908-8e3b-3de0822dcd04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:47:29 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-96d79c72-f8bd-4907-b117-30affeee4d8d tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Created volume successfully. Jun 02 00:47:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Acquiring lock "cinder-7e036cb2-9858-4d1c-8a84-3bf745cb6d85-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Lock "cinder-7e036cb2-9858-4d1c-8a84-3bf745cb6d85-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Acquiring lock "cinder-quobyte-7e036cb2-9858-4d1c-8a84-3bf745cb6d85" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Lock "cinder-quobyte-7e036cb2-9858-4d1c-8a84-3bf745cb6d85" acquired by "delete_volume" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:30 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9240ce92-7fdb-4610-80cc-c31232f310d9]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:30 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 Jun 02 00:47:30 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:31 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85" returned: 0 in 0.901s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:31 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 Jun 02 00:47:31 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:32 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85" returned: 1 in 0.971s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:47:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:32 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85 Jun 02 00:47:32 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:32 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7e036cb2-9858-4d1c-8a84-3bf745cb6d85" returned: 0 in 0.702s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:33 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Lock "cinder-quobyte-7e036cb2-9858-4d1c-8a84-3bf745cb6d85" released by "delete_volume" :: held 2.654s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:33 devstack cinder-volume[86910]: WARNING cinder.quota [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:47:33 devstack cinder-volume[86910]: WARNING cinder.quota [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 02 00:47:33 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Created reservations ['5c7afb67-ebcc-4a26-810b-2f408dcc4e25', 'cc9c7cba-3a41-48dd-a106-0ffc5038941f', '400c1bff-1daa-464f-a6c6-f6bfef373492', '54f1a7ae-02a0-48f9-8f3a-c7787a6febd6'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:47:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:33 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:33 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:47:33 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:34 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.970s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:34 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:47:34 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Deleted volume successfully. Jun 02 00:47:34 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-305b9300-fbc0-459f-89d0-03ad71764b69 tempest-VolumeAndVolumeTypeFromImageTest-987150397 None] Lock "cinder-7e036cb2-9858-4d1c-8a84-3bf745cb6d85-delete_volume" released by "delete_volume" :: held 3.952s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:35 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:47:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Flow 'volume_create_manager' (6a349f85-d9e3-40ed-bbb0-d6cd371712cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:47:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8750cfe-fa6d-414c-8686-cde030804603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8750cfe-fa6d-414c-8686-cde030804603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=120b951e-7cba-4d5a-8e9f-388fa0b5f581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feddaec6f71a4a7bbfaf517eddc3c83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:36Z,use_quota=True,user_id='0bb9ee55c545429897d6d87cad05c790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2c0471-ae37-4b93-aa61-19d0dfe7bda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2c0471-ae37-4b93-aa61-19d0dfe7bda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:35 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74aeb75e-8d01-40fb-a071-1bcc794f170f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:35 devstack cinder-volume[86910]: DEBUG cinder.image.glance [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Creating Keystone auth plugin from conf {{(pid=86910) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 00:47:36 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74aeb75e-8d01-40fb-a071-1bcc794f170f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '120b951e-7cba-4d5a-8e9f-388fa0b5f581', 'volume_name': 'volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581', 'volume_size': 1, 'image_id': '6fb73acc-4258-4fd6-a5a9-eece8199a2d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fb73acc-4258-4fd6-a5a9-eece8199a2d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fb511fcf9216207cc1d72b9ca87e8a42', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'feddaec6f71a4a7bbfaf517eddc3c83c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '336c84b132a2142801dbcf13e66d9127304dbd92aa2db27b2b60b42ecae105fd5a460fdf7ecd2022097c74476666582cc469fa4fbadcab5256b93e581c45ceae', 'id': '6fb73acc-4258-4fd6-a5a9-eece8199a2d0', 'created_at': datetime.datetime(2026, 6, 1, 22, 47, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 47, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fb73acc-4258-4fd6-a5a9-eece8199a2d0/file', 'properties': {}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:36 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50c444b-112b-44ae-aa66-65936f782320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:36 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50c444b-112b-44ae-aa66-65936f782320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:36 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc818d7-20a0-4e7c-9a6c-c68eba899ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:36 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Volume 120b951e-7cba-4d5a-8e9f-388fa0b5f581: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581', 'volume_size': 1, 'image_id': '6fb73acc-4258-4fd6-a5a9-eece8199a2d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fb73acc-4258-4fd6-a5a9-eece8199a2d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fb511fcf9216207cc1d72b9ca87e8a42', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'feddaec6f71a4a7bbfaf517eddc3c83c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '336c84b132a2142801dbcf13e66d9127304dbd92aa2db27b2b60b42ecae105fd5a460fdf7ecd2022097c74476666582cc469fa4fbadcab5256b93e581c45ceae', 'id': '6fb73acc-4258-4fd6-a5a9-eece8199a2d0', 'created_at': datetime.datetime(2026, 6, 1, 22, 47, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 47, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fb73acc-4258-4fd6-a5a9-eece8199a2d0/file', 'properties': {}}, 'image_service': } Jun 02 00:47:36 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Trying to clone 120b951e-7cba-4d5a-8e9f-388fa0b5f581 from image 6fb73acc-4258-4fd6-a5a9-eece8199a2d0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6fb73acc-4258-4fd6-a5a9-eece8199a2d0', 'metadata': {}}]). {{(pid=86910) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 00:47:36 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 00:47:36 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Image download 0.00 MB at 0.00 MB/s Jun 02 00:47:36 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca67ce0-8930-48e9-8e7c-fd693c8eb847]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:36 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD Jun 02 00:47:36 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:36 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD" returned: 0 in 0.683s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:37 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD Jun 02 00:47:37 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:37 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD" returned: 1 in 0.870s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:47:37 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Temporary image 6fb73acc-4258-4fd6-a5a9-eece8199a2d0 is fetched for user 0bb9ee55c545429897d6d87cad05c790. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 00:47:37 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e725bc9-60f5-4053-a30c-da3c5ed86ba5]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:38 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD Jun 02 00:47:38 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:38 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD" returned: 0 in 0.733s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:38 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD Jun 02 00:47:38 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:39 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD" returned: 1 in 0.744s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:47:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:39 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=120b951e-7cba-4d5a-8e9f-388fa0b5f581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feddaec6f71a4a7bbfaf517eddc3c83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:36Z,use_quota=True,user_id='0bb9ee55c545429897d6d87cad05c790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:47:39 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Creating volume 120b951e-7cba-4d5a-8e9f-388fa0b5f581 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:47:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:39 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:39 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:39 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:47:39 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:47:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:39 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 1073741824 Jun 02 00:47:39 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:40 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 1073741824" returned: 0 in 0.896s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:40 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 Jun 02 00:47:40 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:40 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581" returned: 0 in 0.667s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:40 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:47:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:41 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Attempting download of 6fb73acc-4258-4fd6-a5a9-eece8199a2d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/6fb73acc-4258-4fd6-a5a9-eece8199a2d0', 'metadata': {}}])) to volume 120b951e-7cba-4d5a-8e9f-388fa0b5f581. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 00:47:41 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[41599f56-473b-4959-9528-076be2d18ba9]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_tmzute8g {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:41 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_tmzute8g Jun 02 00:47:41 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:41 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_tmzute8g" returned: 0 in 0.884s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_tmzute8g {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:42 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_tmzute8g Jun 02 00:47:42 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:42 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_tmzute8g" returned: 1 in 0.989s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_tmzute8g' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:47:42 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4395e2-493b-4e4c-8a55-0b28e8fbaccd]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:43 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD Jun 02 00:47:43 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:43 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD" returned: 0 in 0.941s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:44 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD Jun 02 00:47:44 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:44 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD" returned: 1 in 0.857s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:47:44 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] 6fb73acc-4258-4fd6-a5a9-eece8199a2d0 was raw, converting to raw {{(pid=86910) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 00:47:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:44 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 Jun 02 00:47:44 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:45 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581" returned: 0 in 0.859s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:45 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6fb73acc-4258-4fd6-a5a9-eece8199a2d0_bh3xw9ypdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:47:45 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Converted 0.00 MB image at 0.00 MB/s Jun 02 00:47:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:45 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 1G Jun 02 00:47:45 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:46 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 1G" returned: 0 in 0.894s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:46 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d37fcac-fe04-4d0f-a2a8-73dde720c5a8]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:46 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 Jun 02 00:47:46 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:46 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:47:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Flow 'volume_create_manager' (26e4a84a-6eca-41a5-bbba-e9280122b851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:47:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28fa23b7-afe2-4403-baf7-d65a69e28e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28fa23b7-afe2-4403-baf7-d65a69e28e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-288178434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2455019f-7c8f-401b-bf0f-b1865c603280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e84c0d74b542109c1f61482c16caa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:47Z,use_quota=True,user_id='62daa7d49671415ab4471b9b8f87afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cce4fbd-0fc9-4c67-bea8-19a51380a470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cce4fbd-0fc9-4c67-bea8-19a51380a470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b043f29-2b22-4cb1-86aa-2cc9527ac305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b043f29-2b22-4cb1-86aa-2cc9527ac305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2455019f-7c8f-401b-bf0f-b1865c603280', 'volume_name': 'volume-2455019f-7c8f-401b-bf0f-b1865c603280', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (014855a1-7e5b-46a5-b097-2c508185cb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (014855a1-7e5b-46a5-b097-2c508185cb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ceecd3-8cf5-4f13-8727-dd3a5210ede2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:47 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume 2455019f-7c8f-401b-bf0f-b1865c603280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2455019f-7c8f-401b-bf0f-b1865c603280', 'volume_size': 1} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-288178434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2455019f-7c8f-401b-bf0f-b1865c603280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e84c0d74b542109c1f61482c16caa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:47Z,use_quota=True,user_id='62daa7d49671415ab4471b9b8f87afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Creating volume 2455019f-7c8f-401b-bf0f-b1865c603280 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:47:47 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2455019f-7c8f-401b-bf0f-b1865c603280 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:47 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2455019f-7c8f-401b-bf0f-b1865c603280 1073741824 Jun 02 00:47:47 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:47:47 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Flow 'volume_create_manager' (47551c07-5472-4bf4-a2b3-9c943713112f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2965e6-0bb3-4a4c-9c00-511a45dedddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581" returned: 0 in 1.024s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2965e6-0bb3-4a4c-9c00-511a45dedddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-363456144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c2c8c2-5311-4436-b181-5bb22e8ad1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77fc00aaa9424bee8308655e10c30ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:47Z,use_quota=True,user_id='51722b07b3244e1fb6eda8c42ac817cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5f8bac-b3fd-4645-ad0a-3ef985266757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5f8bac-b3fd-4645-ad0a-3ef985266757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7eee56-7fd5-4ea9-9165-cb8e3b47b695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:47 devstack cinder-volume[86910]: DEBUG cinder.image.glance [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Creating Keystone auth plugin from conf {{(pid=86910) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 00:47:47 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 Jun 02 00:47:47 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7eee56-7fd5-4ea9-9165-cb8e3b47b695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '24c2c8c2-5311-4436-b181-5bb22e8ad1b8', 'volume_name': 'volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8', 'volume_size': 1, 'image_id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '213591b260fd4db58e9aae1daeaec391', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'created_at': datetime.datetime(2026, 6, 1, 22, 25, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 25, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b93abc4-d162-4478-b919-a527963e0e4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00c7d10-5ed8-42d5-bb70-a326ef5f94d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00c7d10-5ed8-42d5-bb70-a326ef5f94d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:48 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c00e56-052f-4d60-b181-0d5a63473aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:48 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Volume 24c2c8c2-5311-4436-b181-5bb22e8ad1b8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8', 'volume_size': 1, 'image_id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '213591b260fd4db58e9aae1daeaec391', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'created_at': datetime.datetime(2026, 6, 1, 22, 25, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 25, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b93abc4-d162-4478-b919-a527963e0e4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Trying to clone 24c2c8c2-5311-4436-b181-5bb22e8ad1b8 from image 1b93abc4-d162-4478-b919-a527963e0e4e at location (None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}]). {{(pid=86910) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2455019f-7c8f-401b-bf0f-b1865c603280 1073741824" returned: 0 in 1.123s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2455019f-7c8f-401b-bf0f-b1865c603280 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:48 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2455019f-7c8f-401b-bf0f-b1865c603280 Jun 02 00:47:48 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_ox9o7wh7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 00:47:48 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Image download 20.69 MB at 20.69 MB/s Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63ffdfc-632b-47a7-b0ac-17d97ebbdef3]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_ox9o7wh7devstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:48 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581" returned: 1 in 1.094s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Downloaded image 6fb73acc-4258-4fd6-a5a9-eece8199a2d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/6fb73acc-4258-4fd6-a5a9-eece8199a2d0', 'metadata': {}}])) to volume 120b951e-7cba-4d5a-8e9f-388fa0b5f581 successfully. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Temporary image 6fb73acc-4258-4fd6-a5a9-eece8199a2d0 for user 0bb9ee55c545429897d6d87cad05c790 is deleted. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Marking volume 120b951e-7cba-4d5a-8e9f-388fa0b5f581 as bootable. {{(pid=86910) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Copying metadata from image 6fb73acc-4258-4fd6-a5a9-eece8199a2d0 to 120b951e-7cba-4d5a-8e9f-388fa0b5f581. {{(pid=86910) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Creating volume glance metadata for volume 120b951e-7cba-4d5a-8e9f-388fa0b5f581 backed by image 6fb73acc-4258-4fd6-a5a9-eece8199a2d0 with: {'image_id': '6fb73acc-4258-4fd6-a5a9-eece8199a2d0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fb511fcf9216207cc1d72b9ca87e8a42', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86910) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 00:47:48 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_ox9o7wh7devstack@QuobyteHD Jun 02 00:47:48 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc818d7-20a0-4e7c-9a6c-c68eba899ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581', 'volume_size': 1, 'image_id': '6fb73acc-4258-4fd6-a5a9-eece8199a2d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fb73acc-4258-4fd6-a5a9-eece8199a2d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fb511fcf9216207cc1d72b9ca87e8a42', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'feddaec6f71a4a7bbfaf517eddc3c83c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '336c84b132a2142801dbcf13e66d9127304dbd92aa2db27b2b60b42ecae105fd5a460fdf7ecd2022097c74476666582cc469fa4fbadcab5256b93e581c45ceae', 'id': '6fb73acc-4258-4fd6-a5a9-eece8199a2d0', 'created_at': datetime.datetime(2026, 6, 1, 22, 47, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 47, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fb73acc-4258-4fd6-a5a9-eece8199a2d0/file', 'properties': {}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f20851-b47e-49ee-aa23-bf1f3eafe62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:48 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Volume volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 (120b951e-7cba-4d5a-8e9f-388fa0b5f581): created successfully Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f20851-b47e-49ee-aa23-bf1f3eafe62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Flow 'volume_create_manager' (6a349f85-d9e3-40ed-bbb0-d6cd371712cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:47:48 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f54ef754-458a-4c37-b3bd-82cda29ef038 tempest-VolumeImageDependencyTests-1657228246 None] Created volume successfully. Jun 02 00:47:49 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2455019f-7c8f-401b-bf0f-b1865c603280" returned: 0 in 1.053s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] <== create_volume: return (2232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:47:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.234s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ceecd3-8cf5-4f13-8727-dd3a5210ede2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2455019f-7c8f-401b-bf0f-b1865c603280', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6688f66-8c08-4e41-b21e-e87f3a9ab872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:49 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume volume-2455019f-7c8f-401b-bf0f-b1865c603280 (2455019f-7c8f-401b-bf0f-b1865c603280): created successfully Jun 02 00:47:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6688f66-8c08-4e41-b21e-e87f3a9ab872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Flow 'volume_create_manager' (26e4a84a-6eca-41a5-bbba-e9280122b851) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:47:49 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a25f8aef-601d-4f6d-a316-0d23ba1540b0 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Created volume successfully. Jun 02 00:47:49 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_ox9o7wh7devstack@QuobyteHD" returned: 0 in 0.790s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:49 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Temporary image 1b93abc4-d162-4478-b919-a527963e0e4e is fetched for user 51722b07b3244e1fb6eda8c42ac817cd. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 00:47:49 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[45273883-47c7-4ffd-95b2-bdff7d4d7755]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_ox9o7wh7devstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:49 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_ox9o7wh7devstack@QuobyteHD Jun 02 00:47:49 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:49 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Acquiring lock "cinder-120b951e-7cba-4d5a-8e9f-388fa0b5f581-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Lock "cinder-120b951e-7cba-4d5a-8e9f-388fa0b5f581-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Acquiring lock "cinder-quobyte-120b951e-7cba-4d5a-8e9f-388fa0b5f581" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Lock "cinder-quobyte-120b951e-7cba-4d5a-8e9f-388fa0b5f581" acquired by "delete_volume" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d78954b-15b8-4f4e-955c-41ec5e15bf6d]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:50 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 Jun 02 00:47:50 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:50 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_ox9o7wh7devstack@QuobyteHD" returned: 0 in 0.826s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-363456144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c2c8c2-5311-4436-b181-5bb22e8ad1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77fc00aaa9424bee8308655e10c30ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:47Z,use_quota=True,user_id='51722b07b3244e1fb6eda8c42ac817cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Creating volume 24c2c8c2-5311-4436-b181-5bb22e8ad1b8 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:47:50 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:50 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 1073741824 Jun 02 00:47:50 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Flow 'volume_create_manager' (b3e0be72-b1b5-4552-8cfb-c103c78291ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a3afe0-d8c1-457d-a779-2e63943bb41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a3afe0-d8c1-457d-a779-2e63943bb41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1244204776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=214dcbfe-33d5-45cd-9349-5032354b9df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e84c0d74b542109c1f61482c16caa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:51Z,use_quota=True,user_id='62daa7d49671415ab4471b9b8f87afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbba505-97f1-4527-9fff-2339b05dd638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbba505-97f1-4527-9fff-2339b05dd638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918443a1-5c99-4e51-9a0e-7668ab1c29b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918443a1-5c99-4e51-9a0e-7668ab1c29b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '214dcbfe-33d5-45cd-9349-5032354b9df7', 'volume_name': 'volume-214dcbfe-33d5-45cd-9349-5032354b9df7', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7a48d7-2de0-41f1-8a65-a00c567bdbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7a48d7-2de0-41f1-8a65-a00c567bdbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25247e06-6c6e-4433-92d1-99e7c1f782c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:50 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume 214dcbfe-33d5-45cd-9349-5032354b9df7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-214dcbfe-33d5-45cd-9349-5032354b9df7', 'volume_size': 1} Jun 02 00:47:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:47:51 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Flow 'volume_create_manager' (6aa172b7-3d5b-4ea4-995f-a26e710f470d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7cd5390-b931-4e1b-8312-4e2ad2922778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581" returned: 0 in 1.150s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7cd5390-b931-4e1b-8312-4e2ad2922778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-933008607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15bc0bc1-eb23-499c-973a-b7e4ec19188e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e84c0d74b542109c1f61482c16caa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:51Z,use_quota=True,user_id='62daa7d49671415ab4471b9b8f87afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7c2fd4-a33c-4c0e-9267-51262deaa7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7c2fd4-a33c-4c0e-9267-51262deaa7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecaca09-3b0d-4829-af2a-c62b23a9e0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecaca09-3b0d-4829-af2a-c62b23a9e0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15bc0bc1-eb23-499c-973a-b7e4ec19188e', 'volume_name': 'volume-15bc0bc1-eb23-499c-973a-b7e4ec19188e', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2cb4855-bf96-4905-a7d1-63f114794e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2cb4855-bf96-4905-a7d1-63f114794e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c35810f-3ab1-4e75-90da-55cec6114fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:51 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume 15bc0bc1-eb23-499c-973a-b7e4ec19188e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15bc0bc1-eb23-499c-973a-b7e4ec19188e', 'volume_size': 1} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:51 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 Jun 02 00:47:51 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Flow 'volume_create_manager' (efa2ed23-1e7c-485d-9895-25d4eac703b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dcc464-a6a8-4ef6-9d49-3cdff1d70427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dcc464-a6a8-4ef6-9d49-3cdff1d70427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1870969559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759f3a75-55f9-48a0-b7b5-66808d1b61e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e84c0d74b542109c1f61482c16caa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:52Z,use_quota=True,user_id='62daa7d49671415ab4471b9b8f87afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f54750d-5505-48be-8992-31797aa57808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f54750d-5505-48be-8992-31797aa57808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8fb9a6-91af-41bd-a54d-fb8b39cf7323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8fb9a6-91af-41bd-a54d-fb8b39cf7323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759f3a75-55f9-48a0-b7b5-66808d1b61e2', 'volume_name': 'volume-759f3a75-55f9-48a0-b7b5-66808d1b61e2', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc7566f-f9ba-4dd3-b117-fb8f48ac3129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc7566f-f9ba-4dd3-b117-fb8f48ac3129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98c20d6-d8cd-4955-b1e2-8a67fe3153f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:51 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume 759f3a75-55f9-48a0-b7b5-66808d1b61e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759f3a75-55f9-48a0-b7b5-66808d1b61e2', 'volume_size': 1} Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:51 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 1073741824" returned: 0 in 1.576s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:52 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 Jun 02 00:47:52 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Flow 'volume_create_manager' (b9c76041-8e8c-41ea-84e5-a62129962f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6265344-1930-48ec-8112-2682bc20cdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6265344-1930-48ec-8112-2682bc20cdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1092635565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e23f5e65-01ea-40fc-9309-0a682618c15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e84c0d74b542109c1f61482c16caa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:52Z,use_quota=True,user_id='62daa7d49671415ab4471b9b8f87afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623e4401-ba8a-4c1e-9105-722bfe0817a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623e4401-ba8a-4c1e-9105-722bfe0817a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a77661-1957-4edf-a208-1fc3e7c60321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a77661-1957-4edf-a208-1fc3e7c60321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e23f5e65-01ea-40fc-9309-0a682618c15e', 'volume_name': 'volume-e23f5e65-01ea-40fc-9309-0a682618c15e', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c9616f-dd27-4ddc-94d3-62e45c9d8957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c9616f-dd27-4ddc-94d3-62e45c9d8957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874798d6-6f79-4383-ac14-fd25c8cb4768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:52 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume e23f5e65-01ea-40fc-9309-0a682618c15e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e23f5e65-01ea-40fc-9309-0a682618c15e', 'volume_size': 1} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:52 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581" returned: 1 in 1.043s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:52 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581 Jun 02 00:47:52 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Flow 'volume_create_manager' (1d3f7841-dd2a-4a15-905e-d6438e2835fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26f9fda-e1d8-45d5-b235-a34d23f2a5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26f9fda-e1d8-45d5-b235-a34d23f2a5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-103111656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ed2060-ede8-4aa9-afd2-380f62735e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e84c0d74b542109c1f61482c16caa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:52Z,use_quota=True,user_id='62daa7d49671415ab4471b9b8f87afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a035a5f0-b574-4696-8fe8-d9ca5ae04dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a035a5f0-b574-4696-8fe8-d9ca5ae04dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eadf06e-a081-4982-a881-3b950450528e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eadf06e-a081-4982-a881-3b950450528e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ed2060-ede8-4aa9-afd2-380f62735e6d', 'volume_name': 'volume-76ed2060-ede8-4aa9-afd2-380f62735e6d', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0899b678-9dc4-48b1-964f-dec54c3ddc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0899b678-9dc4-48b1-964f-dec54c3ddc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23763c3-891e-494b-bc0b-4ea12467cc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:52 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume 76ed2060-ede8-4aa9-afd2-380f62735e6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ed2060-ede8-4aa9-afd2-380f62735e6d', 'volume_size': 1} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:52 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8" returned: 0 in 0.856s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] <== create_volume: return (2505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.508s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.955s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1244204776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=214dcbfe-33d5-45cd-9349-5032354b9df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e84c0d74b542109c1f61482c16caa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:51Z,use_quota=True,user_id='62daa7d49671415ab4471b9b8f87afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Creating volume 214dcbfe-33d5-45cd-9349-5032354b9df7 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:47:52 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-214dcbfe-33d5-45cd-9349-5032354b9df7 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:52 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Attempting download of 1b93abc4-d162-4478-b919-a527963e0e4e ((None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}])) to volume 24c2c8c2-5311-4436-b181-5bb22e8ad1b8. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 00:47:52 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-214dcbfe-33d5-45cd-9349-5032354b9df7 1073741824 Jun 02 00:47:52 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:53 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83ba3db-3f58-4c57-9cfe-b39f9ffc6217]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_0jeu3lox {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:53 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-120b951e-7cba-4d5a-8e9f-388fa0b5f581" returned: 0 in 0.743s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:53 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Lock "cinder-quobyte-120b951e-7cba-4d5a-8e9f-388fa0b5f581" released by "delete_volume" :: held 3.059s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:53 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_0jeu3lox Jun 02 00:47:53 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:53 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Created reservations ['c4998185-dbb6-4373-b440-f29601275376', '8281226e-7eeb-4fef-b6ca-ea7edf2aaf81', '8c05c549-1f4e-4cf7-bf21-067ac2bb8a5c', '465e8c7e-39f7-485c-8cb3-738454610f17'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:47:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:53 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:53 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:53 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:47:53 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:54 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-214dcbfe-33d5-45cd-9349-5032354b9df7 1073741824" returned: 0 in 1.142s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-214dcbfe-33d5-45cd-9349-5032354b9df7 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:54 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_0jeu3lox" returned: 0 in 1.109s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_0jeu3lox {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:54 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-214dcbfe-33d5-45cd-9349-5032354b9df7 Jun 02 00:47:54 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:54 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.911s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:47:54 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Deleted volume successfully. Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-131d3010-11a4-43be-b9df-a31a9f77868e tempest-VolumeImageDependencyTests-1657228246 None] Lock "cinder-120b951e-7cba-4d5a-8e9f-388fa0b5f581-delete_volume" released by "delete_volume" :: held 4.255s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:47:54 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_0jeu3lox Jun 02 00:47:54 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:54 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-214dcbfe-33d5-45cd-9349-5032354b9df7" returned: 0 in 0.807s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.482s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-933008607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15bc0bc1-eb23-499c-973a-b7e4ec19188e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e84c0d74b542109c1f61482c16caa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:51Z,use_quota=True,user_id='62daa7d49671415ab4471b9b8f87afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Creating volume 15bc0bc1-eb23-499c-973a-b7e4ec19188e {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:47:54 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-15bc0bc1-eb23-499c-973a-b7e4ec19188e 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25247e06-6c6e-4433-92d1-99e7c1f782c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-214dcbfe-33d5-45cd-9349-5032354b9df7', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988757a5-0823-42a8-aca1-a046630f45f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:54 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-15bc0bc1-eb23-499c-973a-b7e4ec19188e 1073741824 Jun 02 00:47:54 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:55 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume volume-214dcbfe-33d5-45cd-9349-5032354b9df7 (214dcbfe-33d5-45cd-9349-5032354b9df7): created successfully Jun 02 00:47:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988757a5-0823-42a8-aca1-a046630f45f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Flow 'volume_create_manager' (b3e0be72-b1b5-4552-8cfb-c103c78291ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:47:55 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-41d81a1e-220e-4fbc-be15-bdfae26e646e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Created volume successfully. Jun 02 00:47:55 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_0jeu3lox" returned: 1 in 0.953s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b93abc4-d162-4478-b919-a527963e0e4e_0jeu3lox' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:47:55 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d444ae9d-b044-4b66-847a-6457d381e139]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_ox9o7wh7devstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:55 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_ox9o7wh7devstack@QuobyteHD Jun 02 00:47:55 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:55 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-15bc0bc1-eb23-499c-973a-b7e4ec19188e 1073741824" returned: 0 in 0.970s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-15bc0bc1-eb23-499c-973a-b7e4ec19188e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:55 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-15bc0bc1-eb23-499c-973a-b7e4ec19188e Jun 02 00:47:55 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:56 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_ox9o7wh7devstack@QuobyteHD" returned: 0 in 0.902s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] 1b93abc4-d162-4478-b919-a527963e0e4e was qcow2, converting to raw {{(pid=86910) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_ox9o7wh7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:56 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_ox9o7wh7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 Jun 02 00:47:56 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:56 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-15bc0bc1-eb23-499c-973a-b7e4ec19188e" returned: 0 in 0.655s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.820s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1870969559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759f3a75-55f9-48a0-b7b5-66808d1b61e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e84c0d74b542109c1f61482c16caa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:52Z,use_quota=True,user_id='62daa7d49671415ab4471b9b8f87afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Creating volume 759f3a75-55f9-48a0-b7b5-66808d1b61e2 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:47:56 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-759f3a75-55f9-48a0-b7b5-66808d1b61e2 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c35810f-3ab1-4e75-90da-55cec6114fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15bc0bc1-eb23-499c-973a-b7e4ec19188e', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930188b6-d48e-41a5-8593-506ad1ed00e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:56 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-759f3a75-55f9-48a0-b7b5-66808d1b61e2 1073741824 Jun 02 00:47:56 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:56 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume volume-15bc0bc1-eb23-499c-973a-b7e4ec19188e (15bc0bc1-eb23-499c-973a-b7e4ec19188e): created successfully Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930188b6-d48e-41a5-8593-506ad1ed00e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Flow 'volume_create_manager' (6aa172b7-3d5b-4ea4-995f-a26e710f470d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:47:56 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-119f49b5-69ec-4985-8622-68714fd9ba1a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Created volume successfully. Jun 02 00:47:57 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-759f3a75-55f9-48a0-b7b5-66808d1b61e2 1073741824" returned: 0 in 1.059s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-759f3a75-55f9-48a0-b7b5-66808d1b61e2 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:57 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-759f3a75-55f9-48a0-b7b5-66808d1b61e2 Jun 02 00:47:57 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:58 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_ox9o7wh7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8" returned: 0 in 2.312s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1b93abc4-d162-4478-b919-a527963e0e4e_ox9o7wh7devstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:47:58 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Converted 112.00 MB image at 48.39 MB/s Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:58 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 1G Jun 02 00:47:58 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:58 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-759f3a75-55f9-48a0-b7b5-66808d1b61e2" returned: 0 in 0.876s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.369s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1092635565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e23f5e65-01ea-40fc-9309-0a682618c15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e84c0d74b542109c1f61482c16caa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:52Z,use_quota=True,user_id='62daa7d49671415ab4471b9b8f87afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Creating volume e23f5e65-01ea-40fc-9309-0a682618c15e {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:47:58 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e23f5e65-01ea-40fc-9309-0a682618c15e 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:58 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e23f5e65-01ea-40fc-9309-0a682618c15e 1073741824 Jun 02 00:47:58 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98c20d6-d8cd-4955-b1e2-8a67fe3153f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759f3a75-55f9-48a0-b7b5-66808d1b61e2', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107c9c91-2267-4d33-a94e-ec6b0f7c9016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:47:58 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume volume-759f3a75-55f9-48a0-b7b5-66808d1b61e2 (759f3a75-55f9-48a0-b7b5-66808d1b61e2): created successfully Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107c9c91-2267-4d33-a94e-ec6b0f7c9016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:47:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Flow 'volume_create_manager' (efa2ed23-1e7c-485d-9895-25d4eac703b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:47:58 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f21280b6-efd8-4e48-b5c1-188451156b64 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Created volume successfully. Jun 02 00:47:59 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 1G" returned: 0 in 0.897s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:59 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f1c66c-16d0-439a-b406-df541ae274f7]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:47:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:59 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 Jun 02 00:47:59 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:47:59 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Jun 02 00:47:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e23f5e65-01ea-40fc-9309-0a682618c15e 1073741824" returned: 0 in 1.177s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:47:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e23f5e65-01ea-40fc-9309-0a682618c15e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:47:59 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e23f5e65-01ea-40fc-9309-0a682618c15e Jun 02 00:47:59 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:00 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8" returned: 0 in 0.963s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:00 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 Jun 02 00:48:00 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:00 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e23f5e65-01ea-40fc-9309-0a682618c15e" returned: 0 in 0.895s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.143s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.154s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-103111656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ed2060-ede8-4aa9-afd2-380f62735e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e84c0d74b542109c1f61482c16caa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:47:52Z,use_quota=True,user_id='62daa7d49671415ab4471b9b8f87afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Creating volume 76ed2060-ede8-4aa9-afd2-380f62735e6d {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:48:00 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76ed2060-ede8-4aa9-afd2-380f62735e6d 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874798d6-6f79-4383-ac14-fd25c8cb4768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e23f5e65-01ea-40fc-9309-0a682618c15e', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60a96b9-864c-40bf-bd5a-97889d4093b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:48:00 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76ed2060-ede8-4aa9-afd2-380f62735e6d 1073741824 Jun 02 00:48:00 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:00 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume volume-e23f5e65-01ea-40fc-9309-0a682618c15e (e23f5e65-01ea-40fc-9309-0a682618c15e): created successfully Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60a96b9-864c-40bf-bd5a-97889d4093b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:00 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Flow 'volume_create_manager' (b9c76041-8e8c-41ea-84e5-a62129962f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:48:00 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a8024cc8-e4e9-4d04-8b0b-f0267c0c2ff4 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Created volume successfully. Jun 02 00:48:01 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8" returned: 1 in 0.889s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Downloaded image 1b93abc4-d162-4478-b919-a527963e0e4e ((None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}])) to volume 24c2c8c2-5311-4436-b181-5bb22e8ad1b8 successfully. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Temporary image 1b93abc4-d162-4478-b919-a527963e0e4e for user 51722b07b3244e1fb6eda8c42ac817cd is deleted. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Marking volume 24c2c8c2-5311-4436-b181-5bb22e8ad1b8 as bootable. {{(pid=86910) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Copying metadata from image 1b93abc4-d162-4478-b919-a527963e0e4e to 24c2c8c2-5311-4436-b181-5bb22e8ad1b8. {{(pid=86910) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Creating volume glance metadata for volume 24c2c8c2-5311-4436-b181-5bb22e8ad1b8 backed by image 1b93abc4-d162-4478-b919-a527963e0e4e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86910) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c00e56-052f-4d60-b181-0d5a63473aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8', 'volume_size': 1, 'image_id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b93abc4-d162-4478-b919-a527963e0e4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '213591b260fd4db58e9aae1daeaec391', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1b93abc4-d162-4478-b919-a527963e0e4e', 'created_at': datetime.datetime(2026, 6, 1, 22, 25, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 25, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b93abc4-d162-4478-b919-a527963e0e4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2fc00f5-a15d-472e-88ff-9ad50a53e843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:48:01 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Volume volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 (24c2c8c2-5311-4436-b181-5bb22e8ad1b8): created successfully Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2fc00f5-a15d-472e-88ff-9ad50a53e843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Flow 'volume_create_manager' (47551c07-5472-4bf4-a2b3-9c943713112f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:48:01 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-dbab88b6-b653-44d0-b423-202fb878500d tempest-TestShelveInstance-691106485 None] Created volume successfully. Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Flow 'volume_create_manager' (b112f610-7b1e-433f-9ab4-77c3f1c6a0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06bda92f-ec95-4c5d-98fe-7a35f64be48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06bda92f-ec95-4c5d-98fe-7a35f64be48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1123817071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb74c4d-4fc4-478f-bfb0-16bd34dda413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eee2df4ad7e47cda39afc50781d9919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:48:02Z,use_quota=True,user_id='4f14803e2f454cdcb58e448dbbdd8598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05be75aa-43ab-4da9-bcc2-5e513ec59193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05be75aa-43ab-4da9-bcc2-5e513ec59193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7ca80d-d7c3-4bf3-a1f3-b85d8df19048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7ca80d-d7c3-4bf3-a1f3-b85d8df19048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffb74c4d-4fc4-478f-bfb0-16bd34dda413', 'volume_name': 'volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5dcee2-4eae-451c-9bda-a7a4bab2ae73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:48:01 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5dcee2-4eae-451c-9bda-a7a4bab2ae73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6537fb2-64f6-48cd-abbd-79d73308a770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:48:01 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Volume ffb74c4d-4fc4-478f-bfb0-16bd34dda413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413', 'volume_size': 1} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76ed2060-ede8-4aa9-afd2-380f62735e6d 1073741824" returned: 0 in 0.869s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76ed2060-ede8-4aa9-afd2-380f62735e6d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:01 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76ed2060-ede8-4aa9-afd2-380f62735e6d Jun 02 00:48:01 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:02 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76ed2060-ede8-4aa9-afd2-380f62735e6d" returned: 0 in 0.610s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.653s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1123817071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb74c4d-4fc4-478f-bfb0-16bd34dda413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eee2df4ad7e47cda39afc50781d9919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:48:02Z,use_quota=True,user_id='4f14803e2f454cdcb58e448dbbdd8598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Creating volume ffb74c4d-4fc4-478f-bfb0-16bd34dda413 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:48:02 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23763c3-891e-494b-bc0b-4ea12467cc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ed2060-ede8-4aa9-afd2-380f62735e6d', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:02 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 1073741824 Jun 02 00:48:02 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d471797e-0656-48bc-a13d-62301bfccf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:48:02 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Volume volume-76ed2060-ede8-4aa9-afd2-380f62735e6d (76ed2060-ede8-4aa9-afd2-380f62735e6d): created successfully Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d471797e-0656-48bc-a13d-62301bfccf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Flow 'volume_create_manager' (1d3f7841-dd2a-4a15-905e-d6438e2835fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:48:02 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ff80a6be-1648-4eb8-bb80-cd2957f95990 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Created volume successfully. Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "cinder-76ed2060-ede8-4aa9-afd2-380f62735e6d-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-76ed2060-ede8-4aa9-afd2-380f62735e6d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "cinder-quobyte-76ed2060-ede8-4aa9-afd2-380f62735e6d" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-quobyte-76ed2060-ede8-4aa9-afd2-380f62735e6d" acquired by "delete_volume" :: waited 0.023s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4f23f7-8c77-4592-b613-ba840765686d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:48:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76ed2060-ede8-4aa9-afd2-380f62735e6d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:03 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76ed2060-ede8-4aa9-afd2-380f62735e6d Jun 02 00:48:03 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:03 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 1073741824" returned: 0 in 0.902s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:03 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 Jun 02 00:48:03 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:03 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76ed2060-ede8-4aa9-afd2-380f62735e6d" returned: 0 in 0.852s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76ed2060-ede8-4aa9-afd2-380f62735e6d {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:03 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76ed2060-ede8-4aa9-afd2-380f62735e6d Jun 02 00:48:03 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:03 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413" returned: 0 in 0.695s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:03 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:48:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:03 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6537fb2-64f6-48cd-abbd-79d73308a770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:03 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661e3b9b-0983-4d1e-b65d-b6474991edcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:48:04 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Volume volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 (ffb74c4d-4fc4-478f-bfb0-16bd34dda413): created successfully Jun 02 00:48:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661e3b9b-0983-4d1e-b65d-b6474991edcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Flow 'volume_create_manager' (b112f610-7b1e-433f-9ab4-77c3f1c6a0a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:48:04 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-6fad245f-5b4a-4802-961f-01efb4208e1f tempest-SnapshotDependencyTests-988327682 None] Created volume successfully. Jun 02 00:48:04 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-76ed2060-ede8-4aa9-afd2-380f62735e6d" returned: 0 in 0.632s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-quobyte-76ed2060-ede8-4aa9-afd2-380f62735e6d" released by "delete_volume" :: held 1.536s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:04 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Created reservations ['de49733c-aa95-404d-8fb9-92f700a9bd83', '4296b072-cd38-499e-a0a4-09299ca1c91b', '81c549c6-bdc2-4c4c-9e67-12dcae988598', '4f8c29fd-2424-48d3-8c01-1f978bed8663'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:48:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:48:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:48:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:04 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:48:04 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] Creating offline snapshot d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 of volume ffb74c4d-4fc4-478f-bfb0-16bd34dda413 {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:48:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "cinder-e23f5e65-01ea-40fc-9309-0a682618c15e-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-e23f5e65-01ea-40fc-9309-0a682618c15e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:05 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[683b4cb1-0d0d-4ae3-b24b-ec44cc324835]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:48:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "cinder-quobyte-e23f5e65-01ea-40fc-9309-0a682618c15e" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-quobyte-e23f5e65-01ea-40fc-9309-0a682618c15e" acquired by "delete_volume" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:05 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.710s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:05 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:48:05 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Deleted volume successfully. Jun 02 00:48:05 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a59443-7d86-43d6-94a4-e5ba93091103]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:48:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e23f5e65-01ea-40fc-9309-0a682618c15e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:05 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 Jun 02 00:48:05 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6b89fb73-47b0-45da-8b4b-540cba66f16a tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-76ed2060-ede8-4aa9-afd2-380f62735e6d-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:05 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e23f5e65-01ea-40fc-9309-0a682618c15e Jun 02 00:48:05 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:05 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413" returned: 0 in 0.752s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:05 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 1G Jun 02 00:48:05 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:06 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e23f5e65-01ea-40fc-9309-0a682618c15e" returned: 0 in 0.746s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e23f5e65-01ea-40fc-9309-0a682618c15e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:06 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e23f5e65-01ea-40fc-9309-0a682618c15e Jun 02 00:48:06 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:06 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e23f5e65-01ea-40fc-9309-0a682618c15e" returned: 0 in 0.591s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:06 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-quobyte-e23f5e65-01ea-40fc-9309-0a682618c15e" released by "delete_volume" :: held 1.416s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:06 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:06 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Created reservations ['cc3108d3-1364-4080-b1be-e47e7cee35f4', '32960c91-6388-4043-846a-3d82b849e9a4', 'a56e99d0-2e29-4b89-8686-5336fc71701c', 'a9fb2e7e-7879-4df6-81e1-9e1e64cb6ca1'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:48:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 1G" returned: 0 in 0.819s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:06 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 Jun 02 00:48:06 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:06 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:48:06 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:48:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:06 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:48:06 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "cinder-759f3a75-55f9-48a0-b7b5-66808d1b61e2-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-759f3a75-55f9-48a0-b7b5-66808d1b61e2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:07 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:07 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.603s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:07 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:48:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7" returned: 0 in 0.688s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:07 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 is being set with open permissions: ugo+rw Jun 02 00:48:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:07 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Deleted volume successfully. Jun 02 00:48:07 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 Jun 02 00:48:07 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "cinder-quobyte-759f3a75-55f9-48a0-b7b5-66808d1b61e2" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-55e86f97-be43-41ff-9d4e-86a2b203eaf7 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-e23f5e65-01ea-40fc-9309-0a682618c15e-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-quobyte-759f3a75-55f9-48a0-b7b5-66808d1b61e2" acquired by "delete_volume" :: waited 0.029s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:07 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[064b5ae5-94d5-40ef-89e0-b1de52a81a83]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:48:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-759f3a75-55f9-48a0-b7b5-66808d1b61e2 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:07 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-759f3a75-55f9-48a0-b7b5-66808d1b61e2 Jun 02 00:48:07 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:08 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7" returned: 0 in 0.659s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:08 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.info Jun 02 00:48:08 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:08 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-759f3a75-55f9-48a0-b7b5-66808d1b61e2" returned: 0 in 0.807s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-759f3a75-55f9-48a0-b7b5-66808d1b61e2 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:08 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-759f3a75-55f9-48a0-b7b5-66808d1b61e2 Jun 02 00:48:08 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:08 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.info" returned: 0 in 0.833s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:08 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.info is being set with open permissions: ugo+rw Jun 02 00:48:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:08 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.info Jun 02 00:48:08 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:09 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-759f3a75-55f9-48a0-b7b5-66808d1b61e2" returned: 0 in 0.691s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-quobyte-759f3a75-55f9-48a0-b7b5-66808d1b61e2" released by "delete_volume" :: held 1.579s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Created reservations ['bf10d560-08c6-4494-89aa-b28ab2309936', '87c49bea-4ea6-4754-a961-f996ee929831', 'a286f6d9-3f34-4e94-91b0-8d0c26c33e48', '51515303-f5d6-46ae-845f-c190aeb425ba'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:09 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:48:09 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-6e1cd670-0170-4e34-9cc5-cfe703910cdd req-1a0a1bda-d2d9-4dc5-9f71-bd4aa4a190f0 tempest-TestShelveInstance-691106485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "cinder-15bc0bc1-eb23-499c-973a-b7e4ec19188e-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-15bc0bc1-eb23-499c-973a-b7e4ec19188e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "cinder-quobyte-15bc0bc1-eb23-499c-973a-b7e4ec19188e" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-quobyte-15bc0bc1-eb23-499c-973a-b7e4ec19188e" acquired by "delete_volume" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:09 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.info" returned: 0 in 0.793s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.658s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[40118548-4783-4cc0-965d-b2ca14b6f7cc]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-6e1cd670-0170-4e34-9cc5-cfe703910cdd req-1a0a1bda-d2d9-4dc5-9f71-bd4aa4a190f0 tempest-TestShelveInstance-691106485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.418s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-15bc0bc1-eb23-499c-973a-b7e4ec19188e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[158f0a8b-5cd8-4ee0-837e-f9950029b463]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-6e1cd670-0170-4e34-9cc5-cfe703910cdd req-1a0a1bda-d2d9-4dc5-9f71-bd4aa4a190f0 tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:09 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-da0d6ce9-db5c-47d4-8942-c6cf03570120 tempest-SnapshotDependencyTests-988327682 None] Create snapshot completed successfully Jun 02 00:48:09 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-15bc0bc1-eb23-499c-973a-b7e4ec19188e Jun 02 00:48:09 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:09 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.705s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:48:09 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 Jun 02 00:48:09 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:09 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Deleted volume successfully. Jun 02 00:48:09 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c7ad02c0-4886-4bc7-acc8-8bec61dadee1 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-759f3a75-55f9-48a0-b7b5-66808d1b61e2-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:10 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-15bc0bc1-eb23-499c-973a-b7e4ec19188e" returned: 0 in 0.878s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-15bc0bc1-eb23-499c-973a-b7e4ec19188e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:10 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-15bc0bc1-eb23-499c-973a-b7e4ec19188e Jun 02 00:48:10 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:10 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-6e1cd670-0170-4e34-9cc5-cfe703910cdd req-1a0a1bda-d2d9-4dc5-9f71-bd4aa4a190f0 tempest-TestShelveInstance-691106485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8" returned: 0 in 0.885s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-6e1cd670-0170-4e34-9cc5-cfe703910cdd req-1a0a1bda-d2d9-4dc5-9f71-bd4aa4a190f0 tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:10 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 Jun 02 00:48:10 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:10 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Flow 'volume_create_manager' (26829166-3476-46b4-ab3d-0572ac0c4e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14cb261-4a81-4e18-bf7f-2cf6249060e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14cb261-4a81-4e18-bf7f-2cf6249060e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732f85f6-e520-42db-a4af-a704b72622ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eee2df4ad7e47cda39afc50781d9919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:48:11Z,use_quota=True,user_id='4f14803e2f454cdcb58e448dbbdd8598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21b4d3c-67fa-4019-8667-422ee3a12725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21b4d3c-67fa-4019-8667-422ee3a12725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e6d753-9742-4cde-80d7-7c383823e3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e6d753-9742-4cde-80d7-7c383823e3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '732f85f6-e520-42db-a4af-a704b72622ff', 'volume_name': 'volume-732f85f6-e520-42db-a4af-a704b72622ff', 'volume_size': 1, 'snapshot_id': 'd24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ceba27-6688-40cc-be68-e9ab12321dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ceba27-6688-40cc-be68-e9ab12321dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183699bd-528d-4861-8db3-cfaeb2056881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:48:11 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Volume 732f85f6-e520-42db-a4af-a704b72622ff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-732f85f6-e520-42db-a4af-a704b72622ff', 'volume_size': 1, 'snapshot_id': 'd24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7'} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:11 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-15bc0bc1-eb23-499c-973a-b7e4ec19188e" returned: 0 in 0.832s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-quobyte-15bc0bc1-eb23-499c-973a-b7e4ec19188e" released by "delete_volume" :: held 1.774s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Created reservations ['171340aa-2a0f-4bc9-a482-9e4a99b1af0a', 'de022b6f-607f-403e-bf8e-a60ff5011e2d', '23a91965-a6cb-4661-a41c-330be567ca77', 'ca55156c-03a0-4e46-a5c1-8e27d394e24f'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:48:11 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-6e1cd670-0170-4e34-9cc5-cfe703910cdd req-1a0a1bda-d2d9-4dc5-9f71-bd4aa4a190f0 tempest-TestShelveInstance-691106485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8" returned: 1 in 0.906s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-6e1cd670-0170-4e34-9cc5-cfe703910cdd req-1a0a1bda-d2d9-4dc5-9f71-bd4aa4a190f0 tempest-TestShelveInstance-691106485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-6e1cd670-0170-4e34-9cc5-cfe703910cdd req-1a0a1bda-d2d9-4dc5-9f71-bd4aa4a190f0 tempest-TestShelveInstance-691106485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.842s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.495s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Acquiring lock "cinder-quobyte-d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7-732f85f6-e520-42db-a4af-a704b72622ff" by "_create_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-quobyte-d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7-732f85f6-e520-42db-a4af-a704b72622ff" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Creating volume 732f85f6-e520-42db-a4af-a704b72622ff from snapshot d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 {{(pid=86910) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Acquiring lock "cinder-quobyte-732f85f6-e520-42db-a4af-a704b72622ff" by "_copy_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-quobyte-732f85f6-e520-42db-a4af-a704b72622ff" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] snapshot: d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7, volume: 732f85f6-e520-42db-a4af-a704b72622ff, {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-6e1cd670-0170-4e34-9cc5-cfe703910cdd req-1a0a1bda-d2d9-4dc5-9f71-bd4aa4a190f0 tempest-TestShelveInstance-691106485 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9cf1155e-2a72-4e6f-b0bb-c12f420f1b83', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaf380b-d67e-42e2-966a-75e3f82f279a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:11 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:48:11 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:11 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-6e1cd670-0170-4e34-9cc5-cfe703910cdd req-1a0a1bda-d2d9-4dc5-9f71-bd4aa4a190f0 tempest-TestShelveInstance-691106485 None] attachment_update completed successfully. Jun 02 00:48:11 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 Jun 02 00:48:11 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "cinder-214dcbfe-33d5-45cd-9349-5032354b9df7-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:11 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-214dcbfe-33d5-45cd-9349-5032354b9df7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "cinder-quobyte-214dcbfe-33d5-45cd-9349-5032354b9df7" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-quobyte-214dcbfe-33d5-45cd-9349-5032354b9df7" acquired by "delete_volume" :: waited 0.020s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:12 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c46c63-c41c-42f1-ab65-afe74af2d3ad]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:48:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-214dcbfe-33d5-45cd-9349-5032354b9df7 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:12 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-214dcbfe-33d5-45cd-9349-5032354b9df7 Jun 02 00:48:12 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:12 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.724s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:12 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:48:12 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Deleted volume successfully. Jun 02 00:48:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-8fa8dd8b-ee05-46d4-9c42-4f040f66e911 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-15bc0bc1-eb23-499c-973a-b7e4ec19188e-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:12 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7" returned: 0 in 0.813s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:48:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 00:48:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Creating direct copy from snapshot {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 00:48:12 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29f5d4d-1445-4e2a-893d-cfe0288f5e40]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:48:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:12 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 Jun 02 00:48:12 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:12 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-214dcbfe-33d5-45cd-9349-5032354b9df7" returned: 0 in 0.804s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-214dcbfe-33d5-45cd-9349-5032354b9df7 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:12 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-214dcbfe-33d5-45cd-9349-5032354b9df7 Jun 02 00:48:12 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:13 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413" returned: 0 in 0.784s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:13 devstack cinder-volume[86910]: DEBUG cinder.utils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Path /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-732f85f6-e520-42db-a4af-a704b72622ff not found in is_blk_device check {{(pid=86910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 00:48:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-732f85f6-e520-42db-a4af-a704b72622ff {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:13 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-732f85f6-e520-42db-a4af-a704b72622ff Jun 02 00:48:13 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:13 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-214dcbfe-33d5-45cd-9349-5032354b9df7" returned: 0 in 0.639s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:13 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-quobyte-214dcbfe-33d5-45cd-9349-5032354b9df7" released by "delete_volume" :: held 1.488s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:13 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Created reservations ['e858d40d-3a16-474d-ac6e-956a76c81a65', 'adce5d82-af0d-4ae8-8f3a-301995c37bda', '2f9ddf93-3edd-4602-90f5-f74a54cdd423', '497a62c3-fb57-4bbd-bedd-b41f4b459f59'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:48:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:48:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:48:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:13 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:48:13 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "cinder-2455019f-7c8f-401b-bf0f-b1865c603280-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-2455019f-7c8f-401b-bf0f-b1865c603280-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "cinder-quobyte-2455019f-7c8f-401b-bf0f-b1865c603280" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-quobyte-2455019f-7c8f-401b-bf0f-b1865c603280" acquired by "delete_volume" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:14 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edaab29-f53c-45c3-b041-7dcabc4c4a68]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:48:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2455019f-7c8f-401b-bf0f-b1865c603280 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:14 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.912s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:14 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:48:14 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Deleted volume successfully. Jun 02 00:48:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-53d12c0b-b707-4c85-92e5-9dcb2e0e7b50 tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-214dcbfe-33d5-45cd-9349-5032354b9df7-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:14 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2455019f-7c8f-401b-bf0f-b1865c603280 Jun 02 00:48:14 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:48:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:48:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:48:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:15 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:48:15 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:16 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2455019f-7c8f-401b-bf0f-b1865c603280" returned: 0 in 1.961s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2455019f-7c8f-401b-bf0f-b1865c603280 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:16 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2455019f-7c8f-401b-bf0f-b1865c603280 Jun 02 00:48:16 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:16 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.472s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:16 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:48:17 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2455019f-7c8f-401b-bf0f-b1865c603280" returned: 0 in 1.367s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:17 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-quobyte-2455019f-7c8f-401b-bf0f-b1865c603280" released by "delete_volume" :: held 3.422s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:18 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Created reservations ['92b4d8e6-b7a2-446e-843f-7677b6f6130d', 'f62b52fd-31d8-45ce-95a2-733d62400a97', '3ddedd02-e2ab-43fa-97a4-081060a54c9d', '13e1072f-58ea-49e5-ba93-6c6875863b7c'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:48:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:48:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:48:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:18 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:48:18 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:19 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.452s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:19 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:48:19 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Deleted volume successfully. Jun 02 00:48:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d39fb4d9-9cf5-4ffb-8ed4-9539cc3c213e tempest-CreateVolumesFromSourceVolumeTest-328684970 None] Lock "cinder-2455019f-7c8f-401b-bf0f-b1865c603280-delete_volume" released by "delete_volume" :: held 5.578s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-732f85f6-e520-42db-a4af-a704b72622ff" returned: 0 in 7.328s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:20 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afa7a9c-00d9-4a65-99c1-3be8f750d9f2]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:48:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:20 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 Jun 02 00:48:20 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:22 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413" returned: 0 in 1.424s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:22 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Image conversion details: src /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413, size 1024.00 MB, duration 7.33 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-732f85f6-e520-42db-a4af-a704b72622ff {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:48:22 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Converted 1024.00 MB image at 139.71 MB/s Jun 02 00:48:22 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-732f85f6-e520-42db-a4af-a704b72622ff is being set with open permissions: ugo+rw Jun 02 00:48:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-732f85f6-e520-42db-a4af-a704b72622ff {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:22 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-732f85f6-e520-42db-a4af-a704b72622ff Jun 02 00:48:22 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:22 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-732f85f6-e520-42db-a4af-a704b72622ff" returned: 0 in 0.739s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:22 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-quobyte-732f85f6-e520-42db-a4af-a704b72622ff" released by "_copy_volume_from_snapshot" :: held 11.235s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:22 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-quobyte-d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7-732f85f6-e520-42db-a4af-a704b72622ff" released by "_create_volume_from_snapshot" :: held 11.281s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.309s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183699bd-528d-4861-8db3-cfaeb2056881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-732f85f6-e520-42db-a4af-a704b72622ff', 'volume_size': 1, 'snapshot_id': 'd24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f76fa1-4c2d-4ed8-af7c-99da00db78d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:48:22 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Volume volume-732f85f6-e520-42db-a4af-a704b72622ff (732f85f6-e520-42db-a4af-a704b72622ff): created successfully Jun 02 00:48:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f76fa1-4c2d-4ed8-af7c-99da00db78d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:48:22 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Flow 'volume_create_manager' (26829166-3476-46b4-ab3d-0572ac0c4e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:48:22 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-5a0c277d-68ae-435b-926c-02722e206942 tempest-SnapshotDependencyTests-988327682 None] Created volume successfully. Jun 02 00:48:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] Acquiring lock "cinder-d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] Acquiring lock "cinder-quobyte-ffb74c4d-4fc4-478f-bfb0-16bd34dda413" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-quobyte-ffb74c4d-4fc4-478f-bfb0-16bd34dda413" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] Acquiring lock "cinder-quobyte-d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-quobyte-d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] Deleting offline snapshot d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 of volume ffb74c4d-4fc4-478f-bfb0-16bd34dda413 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:48:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] snapshot_file for this snap is: volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:48:23 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e9dc15-51db-4897-9854-fc140d6617bd]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:48:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:23 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 Jun 02 00:48:23 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:24 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7" returned: 0 in 0.838s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:48:24 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfeb798a-5c97-4e55-a238-43b77aedf81f]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:48:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:24 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 Jun 02 00:48:24 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:24 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413" returned: 0 in 0.733s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:25 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 Jun 02 00:48:25 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:25 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7" returned: 0 in 0.694s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:25 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7 Jun 02 00:48:25 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:26 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413.d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7" returned: 0 in 0.598s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-quobyte-d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7" released by "_delete_snapshot" :: held 2.970s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-quobyte-ffb74c4d-4fc4-478f-bfb0-16bd34dda413" released by "delete_snapshot" :: held 3.005s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:26 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] Created reservations ['778ed243-c4ea-4297-8a2b-d638b573675c', '5737d295-c2b8-4b71-9e81-f2fced25db11', '04fa3b64-154c-4cda-adc2-a0d5b5d819a6', '0d302498-e05c-4fd5-95c0-7f2ad80b1776'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:48:26 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] Delete snapshot completed successfully. Jun 02 00:48:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e2a03d6d-54ff-46fe-a71b-ec046e935b9f tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-d24c429a-6aa1-4a4a-9f6d-7f713ee2e3b7-delete_snapshot" released by "delete_snapshot" :: held 3.147s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] Acquiring lock "cinder-ffb74c4d-4fc4-478f-bfb0-16bd34dda413-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-ffb74c4d-4fc4-478f-bfb0-16bd34dda413-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] Acquiring lock "cinder-quobyte-ffb74c4d-4fc4-478f-bfb0-16bd34dda413" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-quobyte-ffb74c4d-4fc4-478f-bfb0-16bd34dda413" acquired by "delete_volume" :: waited 0.029s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:26 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42ab069-ac5d-47c4-8e25-fb6ade930a92]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:48:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:26 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 Jun 02 00:48:26 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:27 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413" returned: 0 in 0.710s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:27 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413 Jun 02 00:48:27 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:27 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ffb74c4d-4fc4-478f-bfb0-16bd34dda413" returned: 0 in 0.601s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-quobyte-ffb74c4d-4fc4-478f-bfb0-16bd34dda413" released by "delete_volume" :: held 1.365s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:28 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] Created reservations ['12cfea60-7e2a-449e-a4d3-b833186b2c37', '530df3ef-bfc0-48de-a4d3-bfd684e228e4', 'bba15f2f-167f-4abe-aefd-5f14ca14217a', '07715e8a-7761-4cdd-8412-6d37731fbed4'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:48:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:48:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:48:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:28 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:48:28 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:28 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.609s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:28 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:48:28 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] Deleted volume successfully. Jun 02 00:48:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-9611eb58-08bb-475c-98a9-510948ccee82 tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-ffb74c4d-4fc4-478f-bfb0-16bd34dda413-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] Acquiring lock "cinder-732f85f6-e520-42db-a4af-a704b72622ff-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-732f85f6-e520-42db-a4af-a704b72622ff-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] Acquiring lock "cinder-quobyte-732f85f6-e520-42db-a4af-a704b72622ff" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:48:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-quobyte-732f85f6-e520-42db-a4af-a704b72622ff" acquired by "delete_volume" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:48:28 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8605cda-3448-461e-a2ac-f24247ea7a7c]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:48:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-732f85f6-e520-42db-a4af-a704b72622ff {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:29 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-732f85f6-e520-42db-a4af-a704b72622ff Jun 02 00:48:29 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:29 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-732f85f6-e520-42db-a4af-a704b72622ff" returned: 0 in 0.728s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-732f85f6-e520-42db-a4af-a704b72622ff {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:29 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-732f85f6-e520-42db-a4af-a704b72622ff Jun 02 00:48:29 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:30 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-732f85f6-e520-42db-a4af-a704b72622ff" returned: 0 in 0.615s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-quobyte-732f85f6-e520-42db-a4af-a704b72622ff" released by "delete_volume" :: held 1.389s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:30 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:INSERT=42,cinder:SELECT=102,cinder:UPDATE=118,cinder:DELETE=5 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:48:30 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=98,cinder:INSERT=39,cinder:UPDATE=112,cinder:DELETE=16 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:48:30 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] Created reservations ['434df72f-2ba6-4c8e-a164-158ed3c7e753', 'cb9ecdad-694b-4ed8-9a1a-9346534fb6b0', '0f31b9d8-cb32-4e17-8569-0d29ea264638', '54d9b48f-8824-40e1-b41d-3997aa71353b'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:48:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:48:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:48:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:30 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:48:30 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:31 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.613s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:31 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:48:31 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] Deleted volume successfully. Jun 02 00:48:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-1e7c8a1f-3e80-498c-a666-4431a4486c4a tempest-SnapshotDependencyTests-988327682 None] Lock "cinder-732f85f6-e520-42db-a4af-a704b72622ff-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:48:40 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:INSERT=1,cinder:UPDATE=8,cinder:SELECT=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:48:41 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:48:49 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-f78eaabf-7926-45e9-b54b-89a01a787843 req-f7ebd001-8792-4412-b568-600a64e5ed46 tempest-TestShelveInstance-691106485 None] Terminate volume connection completed successfully. Jun 02 00:48:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-f78eaabf-7926-45e9-b54b-89a01a787843 req-f7ebd001-8792-4412-b568-600a64e5ed46 tempest-TestShelveInstance-691106485 None] Deleting attachment 9cf1155e-2a72-4e6f-b0bb-c12f420f1b83. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:48:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-62dd99ca-dc1b-4c26-b8ff-b0652ed9e3b4 req-7981b0c7-f4ea-4105-ab18-ae6d89ebd16d tempest-TestShelveInstance-691106485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:48:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-62dd99ca-dc1b-4c26-b8ff-b0652ed9e3b4 req-7981b0c7-f4ea-4105-ab18-ae6d89ebd16d tempest-TestShelveInstance-691106485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:48:54 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[383262db-9e01-4778-befd-011572ea9469]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:48:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-62dd99ca-dc1b-4c26-b8ff-b0652ed9e3b4 req-7981b0c7-f4ea-4105-ab18-ae6d89ebd16d tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:54 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 Jun 02 00:48:54 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:55 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-62dd99ca-dc1b-4c26-b8ff-b0652ed9e3b4 req-7981b0c7-f4ea-4105-ab18-ae6d89ebd16d tempest-TestShelveInstance-691106485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8" returned: 0 in 0.685s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-62dd99ca-dc1b-4c26-b8ff-b0652ed9e3b4 req-7981b0c7-f4ea-4105-ab18-ae6d89ebd16d tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:48:55 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 Jun 02 00:48:55 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:48:56 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Jun 02 00:48:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-62dd99ca-dc1b-4c26-b8ff-b0652ed9e3b4 req-7981b0c7-f4ea-4105-ab18-ae6d89ebd16d tempest-TestShelveInstance-691106485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8" returned: 1 in 0.672s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:48:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-62dd99ca-dc1b-4c26-b8ff-b0652ed9e3b4 req-7981b0c7-f4ea-4105-ab18-ae6d89ebd16d tempest-TestShelveInstance-691106485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:48:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-62dd99ca-dc1b-4c26-b8ff-b0652ed9e3b4 req-7981b0c7-f4ea-4105-ab18-ae6d89ebd16d tempest-TestShelveInstance-691106485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.396s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:48:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-62dd99ca-dc1b-4c26-b8ff-b0652ed9e3b4 req-7981b0c7-f4ea-4105-ab18-ae6d89ebd16d tempest-TestShelveInstance-691106485 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30dbb1ae-9f63-4f24-a4c2-976e23f7ccda', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:48:56 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-62dd99ca-dc1b-4c26-b8ff-b0652ed9e3b4 req-7981b0c7-f4ea-4105-ab18-ae6d89ebd16d tempest-TestShelveInstance-691106485 None] attachment_update completed successfully. Jun 02 00:49:06 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:49:06 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:49:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:49:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:49:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:49:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:49:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:49:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:49:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:49:15 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:49:15 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:49:15 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Jun 02 00:49:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.623s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:49:15 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:49:32 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-c4ac1946-07c6-4dfd-98c1-d7b379a7a0e6 tempest-TestShelveInstance-691106485 None] Terminate volume connection completed successfully. Jun 02 00:49:32 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-c4ac1946-07c6-4dfd-98c1-d7b379a7a0e6 tempest-TestShelveInstance-691106485 None] Deleting attachment 30dbb1ae-9f63-4f24-a4c2-976e23f7ccda. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:49:33 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Acquiring lock "cinder-24c2c8c2-5311-4436-b181-5bb22e8ad1b8-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:49:33 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Lock "cinder-24c2c8c2-5311-4436-b181-5bb22e8ad1b8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:49:33 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Acquiring lock "cinder-quobyte-24c2c8c2-5311-4436-b181-5bb22e8ad1b8" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:49:33 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Lock "cinder-quobyte-24c2c8c2-5311-4436-b181-5bb22e8ad1b8" acquired by "delete_volume" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:49:33 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[956adcfe-ccea-4fa5-9c1c-71f82767fa4a]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:49:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:49:33 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 Jun 02 00:49:33 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:49:33 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Jun 02 00:49:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8" returned: 0 in 0.686s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:49:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:49:34 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 Jun 02 00:49:34 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:49:34 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Jun 02 00:49:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8" returned: 1 in 0.677s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:49:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:49:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:49:34 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8 Jun 02 00:49:34 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:49:35 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Jun 02 00:49:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-24c2c8c2-5311-4436-b181-5bb22e8ad1b8" returned: 0 in 0.598s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:49:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Lock "cinder-quobyte-24c2c8c2-5311-4436-b181-5bb22e8ad1b8" released by "delete_volume" :: held 2.020s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:49:35 devstack cinder-volume[86910]: DEBUG cinder.quota [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Created reservations ['7a02d6a3-694f-447e-854d-ac40e39d3d08', '09398da5-dfe4-4fac-9996-6edf76a2274c', '1de68408-3d41-4fb7-84a8-0613f1168024', 'b4a39a89-4c1b-4d32-ba78-0e0ac8cf2bdf'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:49:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:49:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:49:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:49:35 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:49:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:49:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:49:35 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:49:35 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:49:35 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Jun 02 00:49:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.598s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:49:35 devstack cinder-volume[86910]: DEBUG cinder.manager [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:49:35 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Deleted volume successfully. Jun 02 00:49:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [req-4ca90e6b-bdd2-4742-9f18-25bc73be1e4b req-b386df25-0032-49ac-a21e-4e96cebb1dac tempest-TestShelveInstance-691106485 None] Lock "cinder-24c2c8c2-5311-4436-b181-5bb22e8ad1b8-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:49:45 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=8,cinder:SELECT=5,cinder:INSERT=2 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:49:45 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Flow 'volume_create_manager' (b4b9911a-a300-4495-8cf4-d4d2acce474f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940986f6-9f53-42d8-93ae-5a2e38b15866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940986f6-9f53-42d8-93ae-5a2e38b15866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2024221132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1904ea-23f9-45e5-9a52-05be8447cdc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce375f2a69b4fff8b665bef608c5be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:50:08Z,use_quota=True,user_id='3016368050024f5084401c7b6a8b15f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c83f7b-1467-4b18-afa8-18a53c6d5b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c83f7b-1467-4b18-afa8-18a53c6d5b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a570e0cc-9a35-4fd9-ab1e-5e44ba17a05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a570e0cc-9a35-4fd9-ab1e-5e44ba17a05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed1904ea-23f9-45e5-9a52-05be8447cdc8', 'volume_name': 'volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb062860-e6ef-4a25-b3e4-9c14af11b22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb062860-e6ef-4a25-b3e4-9c14af11b22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03854cef-168e-4a7c-969d-049f554299ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:50:07 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Volume ed1904ea-23f9-45e5-9a52-05be8447cdc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8', 'volume_size': 1} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2024221132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1904ea-23f9-45e5-9a52-05be8447cdc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce375f2a69b4fff8b665bef608c5be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:50:08Z,use_quota=True,user_id='3016368050024f5084401c7b6a8b15f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Creating volume ed1904ea-23f9-45e5-9a52-05be8447cdc8 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:50:07 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:50:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:50:07 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 1073741824 Jun 02 00:50:07 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:50:08 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Jun 02 00:50:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 1073741824" returned: 0 in 0.819s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:50:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:50:08 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 Jun 02 00:50:08 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:50:09 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Jun 02 00:50:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8" returned: 0 in 0.617s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:50:09 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:50:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:50:09 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03854cef-168e-4a7c-969d-049f554299ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:50:09 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38973072-046f-4678-926c-ada9364f1cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:50:09 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Volume volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 (ed1904ea-23f9-45e5-9a52-05be8447cdc8): created successfully Jun 02 00:50:09 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38973072-046f-4678-926c-ada9364f1cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:50:09 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Flow 'volume_create_manager' (b4b9911a-a300-4495-8cf4-d4d2acce474f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:50:09 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ba9db10f-632f-4db8-b48d-dcbda21da25f tempest-TestStampPattern-2014827699 None] Created volume successfully. Jun 02 00:50:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:50:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:50:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:50:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:50:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:50:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:50:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:50:15 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:50:15 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:50:15 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Jun 02 00:50:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.588s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:50:15 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:50:19 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=2,cinder:UPDATE=6 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:50:19 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=1,cinder:SELECT=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:50:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-66cec026-e839-4c3c-a145-d06343abf5e9 req-7d61643c-d36a-419b-b2b5-1177f5f26d7b tempest-TestStampPattern-2014827699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:50:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-66cec026-e839-4c3c-a145-d06343abf5e9 req-7d61643c-d36a-419b-b2b5-1177f5f26d7b tempest-TestStampPattern-2014827699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:50:47 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[482237f4-2a13-4d0d-9960-627e877922f4]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:50:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-66cec026-e839-4c3c-a145-d06343abf5e9 req-7d61643c-d36a-419b-b2b5-1177f5f26d7b tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:50:47 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 Jun 02 00:50:47 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:50:48 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Jun 02 00:50:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-66cec026-e839-4c3c-a145-d06343abf5e9 req-7d61643c-d36a-419b-b2b5-1177f5f26d7b tempest-TestStampPattern-2014827699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8" returned: 0 in 0.708s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:50:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-66cec026-e839-4c3c-a145-d06343abf5e9 req-7d61643c-d36a-419b-b2b5-1177f5f26d7b tempest-TestStampPattern-2014827699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.727s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:50:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-66cec026-e839-4c3c-a145-d06343abf5e9 req-7d61643c-d36a-419b-b2b5-1177f5f26d7b tempest-TestStampPattern-2014827699 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7de52f9e-33ad-4570-91fd-a3be1eb845a9', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:50:48 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-66cec026-e839-4c3c-a145-d06343abf5e9 req-7d61643c-d36a-419b-b2b5-1177f5f26d7b tempest-TestStampPattern-2014827699 None] attachment_update completed successfully. Jun 02 00:50:56 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-ca1e36a7-c4ab-4cf6-987c-0b123badf6e4 req-16695499-14fd-410b-8521-18171c2331ce tempest-TestStampPattern-2014827699 None] Terminate volume connection completed successfully. Jun 02 00:50:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-ca1e36a7-c4ab-4cf6-987c-0b123badf6e4 req-16695499-14fd-410b-8521-18171c2331ce tempest-TestStampPattern-2014827699 None] Deleting attachment 7de52f9e-33ad-4570-91fd-a3be1eb845a9. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:50:58 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=7 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:50:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:50:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:50:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] Creating offline snapshot 07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe of volume ed1904ea-23f9-45e5-9a52-05be8447cdc8 {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:50:58 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e189979b-fb27-43ff-a41e-e831beeb14b6]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:50:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:50:58 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 Jun 02 00:50:58 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:50:59 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jun 02 00:50:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8" returned: 0 in 0.687s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:50:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:50:59 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe 1G Jun 02 00:50:59 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:51:00 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jun 02 00:51:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe 1G" returned: 0 in 0.735s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:51:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:51:00 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe Jun 02 00:51:00 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:51:00 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jun 02 00:51:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe" returned: 0 in 0.627s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:51:00 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe is being set with open permissions: ugo+rw Jun 02 00:51:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:51:00 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe Jun 02 00:51:00 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:51:01 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jun 02 00:51:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe" returned: 0 in 0.571s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:51:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:51:01 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.info Jun 02 00:51:01 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:51:02 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Jun 02 00:51:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.info" returned: 0 in 0.589s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:51:02 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.info is being set with open permissions: ugo+rw Jun 02 00:51:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:51:02 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.info Jun 02 00:51:02 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:51:02 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jun 02 00:51:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.info" returned: 0 in 0.575s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:51:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.861s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:51:02 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e3350131-61a7-43f3-a696-f1e3767787b6 tempest-TestStampPattern-2014827699 None] Create snapshot completed successfully Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Flow 'volume_create_manager' (0e9a8f0a-9501-4ea3-a8f2-00e020e0245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4579ce-eeae-4a31-b26b-3c514f723f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4579ce-eeae-4a31-b26b-3c514f723f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1563086704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1d4ee4-2f02-45f6-8d71-177f1e715f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce375f2a69b4fff8b665bef608c5be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:51:12Z,use_quota=True,user_id='3016368050024f5084401c7b6a8b15f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdc0886-ede1-4a72-9db4-a3d9146779cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdc0886-ede1-4a72-9db4-a3d9146779cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5805d3b5-bde6-4d70-ab73-75d8c69cbbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5805d3b5-bde6-4d70-ab73-75d8c69cbbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5b1d4ee4-2f02-45f6-8d71-177f1e715f22', 'volume_name': 'volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22', 'volume_size': 1, 'snapshot_id': '07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ff6635-3316-4424-bc1d-dc76e28fbaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ff6635-3316-4424-bc1d-dc76e28fbaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add5ccbb-7f90-4a57-8bdb-96b610528f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:51:12 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Volume 5b1d4ee4-2f02-45f6-8d71-177f1e715f22: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22', 'volume_size': 1, 'snapshot_id': '07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe'} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Acquiring lock "cinder-quobyte-07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe-5b1d4ee4-2f02-45f6-8d71-177f1e715f22" by "_create_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Lock "cinder-quobyte-07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe-5b1d4ee4-2f02-45f6-8d71-177f1e715f22" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Creating volume 5b1d4ee4-2f02-45f6-8d71-177f1e715f22 from snapshot 07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe {{(pid=86910) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Acquiring lock "cinder-quobyte-5b1d4ee4-2f02-45f6-8d71-177f1e715f22" by "_copy_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Lock "cinder-quobyte-5b1d4ee4-2f02-45f6-8d71-177f1e715f22" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] snapshot: 07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe, volume: 5b1d4ee4-2f02-45f6-8d71-177f1e715f22, {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2e0724-5a55-4d19-8906-96d0f344194e]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:51:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:51:12 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe Jun 02 00:51:12 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:51:13 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Jun 02 00:51:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe" returned: 0 in 0.722s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:51:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:51:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 00:51:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Creating direct copy from snapshot {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 00:51:13 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0c6dbc-fb92-4c33-b747-e8ed615bfa17]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:51:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:51:13 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 Jun 02 00:51:13 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:51:14 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jun 02 00:51:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8" returned: 0 in 0.715s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:51:14 devstack cinder-volume[86910]: DEBUG cinder.utils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Path /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22 not found in is_blk_device check {{(pid=86910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 00:51:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:51:14 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22 Jun 02 00:51:14 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:51:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:51:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:51:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:51:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:51:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:51:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:51:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:51:15 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:51:15 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:51:16 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Jun 02 00:51:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 1.740s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:51:17 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:51:19 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jun 02 00:51:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22" returned: 0 in 5.264s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:51:19 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c1c8fe-8cba-4167-893b-13d62d3b1e18]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:51:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:51:19 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 Jun 02 00:51:19 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:51:20 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Jun 02 00:51:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8" returned: 0 in 1.074s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:51:20 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Image conversion details: src /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8, size 1024.00 MB, duration 5.26 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22 {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:51:20 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Converted 1024.00 MB image at 194.50 MB/s Jun 02 00:51:20 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22 is being set with open permissions: ugo+rw Jun 02 00:51:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:51:20 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22 Jun 02 00:51:20 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:51:21 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jun 02 00:51:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22" returned: 0 in 0.766s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:51:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Lock "cinder-quobyte-5b1d4ee4-2f02-45f6-8d71-177f1e715f22" released by "_copy_volume_from_snapshot" :: held 8.641s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:51:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Lock "cinder-quobyte-07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe-5b1d4ee4-2f02-45f6-8d71-177f1e715f22" released by "_create_volume_from_snapshot" :: held 8.672s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:51:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.689s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:51:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add5ccbb-7f90-4a57-8bdb-96b610528f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22', 'volume_size': 1, 'snapshot_id': '07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:51:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47c5609-4d3e-49de-bd41-29c6806b8a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:51:21 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Volume volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22 (5b1d4ee4-2f02-45f6-8d71-177f1e715f22): created successfully Jun 02 00:51:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47c5609-4d3e-49de-bd41-29c6806b8a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:51:21 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Flow 'volume_create_manager' (0e9a8f0a-9501-4ea3-a8f2-00e020e0245a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:51:21 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-632b6fb5-3fb1-46ad-89c9-f7dae18a8506 tempest-TestStampPattern-2014827699 None] Created volume successfully. Jun 02 00:51:31 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=4,cinder:DELETE=1,cinder:UPDATE=3 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:51:31 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:52:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-ae8ea439-9175-4695-b3d4-71b87e805d2a req-53d3bb49-befb-4074-889c-18de2423bf82 tempest-TestStampPattern-2014827699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:52:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-ae8ea439-9175-4695-b3d4-71b87e805d2a req-53d3bb49-befb-4074-889c-18de2423bf82 tempest-TestStampPattern-2014827699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:52:10 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff8f969-1f4c-43a3-afd7-546a0f0bd219]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:52:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-ae8ea439-9175-4695-b3d4-71b87e805d2a req-53d3bb49-befb-4074-889c-18de2423bf82 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:10 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22 Jun 02 00:52:10 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:11 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [req-ae8ea439-9175-4695-b3d4-71b87e805d2a req-53d3bb49-befb-4074-889c-18de2423bf82 tempest-TestStampPattern-2014827699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22" returned: 0 in 0.704s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [req-ae8ea439-9175-4695-b3d4-71b87e805d2a req-53d3bb49-befb-4074-889c-18de2423bf82 tempest-TestStampPattern-2014827699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.720s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:52:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-ae8ea439-9175-4695-b3d4-71b87e805d2a req-53d3bb49-befb-4074-889c-18de2423bf82 tempest-TestStampPattern-2014827699 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736', 'name': 'volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df9fda7e-8638-451a-a99f-95b58e51409c', 'enforce_multipath': True} {{(pid=86910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 02 00:52:11 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-ae8ea439-9175-4695-b3d4-71b87e805d2a req-53d3bb49-befb-4074-889c-18de2423bf82 tempest-TestStampPattern-2014827699 None] attachment_update completed successfully. Jun 02 00:52:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:52:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:52:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:52:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:52:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:52:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:52:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:15 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:52:15 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:15 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.581s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:15 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:52:18 devstack cinder-volume[86910]: INFO cinder.volume.manager [req-04071183-e99e-494c-bd29-c0292f70c00f req-94fb7298-44fe-428f-b89c-a009d5a0fa23 tempest-TestStampPattern-2014827699 None] Terminate volume connection completed successfully. Jun 02 00:52:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [req-04071183-e99e-494c-bd29-c0292f70c00f req-94fb7298-44fe-428f-b89c-a009d5a0fa23 tempest-TestStampPattern-2014827699 None] Deleting attachment df9fda7e-8638-451a-a99f-95b58e51409c. {{(pid=86910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 02 00:52:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] Acquiring lock "cinder-5b1d4ee4-2f02-45f6-8d71-177f1e715f22-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:52:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] Lock "cinder-5b1d4ee4-2f02-45f6-8d71-177f1e715f22-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:52:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] Acquiring lock "cinder-quobyte-5b1d4ee4-2f02-45f6-8d71-177f1e715f22" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:52:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] Lock "cinder-quobyte-5b1d4ee4-2f02-45f6-8d71-177f1e715f22" acquired by "delete_volume" :: waited 0.016s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:52:27 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[916f7c9c-ec9f-4033-bbda-931a411e48d2]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:52:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:27 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22 Jun 02 00:52:27 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:27 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22" returned: 0 in 0.706s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:27 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22 Jun 02 00:52:27 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:28 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5b1d4ee4-2f02-45f6-8d71-177f1e715f22" returned: 0 in 0.584s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] Lock "cinder-quobyte-5b1d4ee4-2f02-45f6-8d71-177f1e715f22" released by "delete_volume" :: held 1.325s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:52:28 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] Created reservations ['86174557-51ba-43b5-af0e-d2e702ca2fe0', '3e3e4adf-2e47-4d03-8464-545f32cf46a2', '2b073ab4-2a00-4ff6-9b2d-449b5c63ce17', '1debdecb-e99e-45d3-a232-97b8b009becb'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:52:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:52:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:52:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:52:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:52:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:52:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:28 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:52:28 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:29 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.569s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:29 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:52:29 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] Deleted volume successfully. Jun 02 00:52:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b2928e63-1c79-470d-8e67-9bcbe1aaf861 tempest-TestStampPattern-2014827699 None] Lock "cinder-5b1d4ee4-2f02-45f6-8d71-177f1e715f22-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:52:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] Acquiring lock "cinder-07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:52:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] Lock "cinder-07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:52:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] Acquiring lock "cinder-quobyte-ed1904ea-23f9-45e5-9a52-05be8447cdc8" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:52:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] Lock "cinder-quobyte-ed1904ea-23f9-45e5-9a52-05be8447cdc8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:52:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] Acquiring lock "cinder-quobyte-07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:52:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] Lock "cinder-quobyte-07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:52:29 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] Deleting offline snapshot 07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe of volume ed1904ea-23f9-45e5-9a52-05be8447cdc8 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:52:29 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] snapshot_file for this snap is: volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:52:29 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0d5951-f1ba-4014-9ee4-b285e29550f2]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:52:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:29 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe Jun 02 00:52:29 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:30 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe" returned: 0 in 0.681s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:52:30 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e260a1c9-8fb3-47e0-80f6-49c2f7eeba4a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:52:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:30 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 Jun 02 00:52:30 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:31 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8" returned: 0 in 0.692s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:31 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe Jun 02 00:52:31 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:31 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe" returned: 0 in 0.676s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:31 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe Jun 02 00:52:31 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:32 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8.07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe" returned: 0 in 0.564s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:32 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] Lock "cinder-quobyte-07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe" released by "_delete_snapshot" :: held 2.709s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:52:32 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] Lock "cinder-quobyte-ed1904ea-23f9-45e5-9a52-05be8447cdc8" released by "delete_snapshot" :: held 2.734s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:52:32 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] Created reservations ['5a3a9cd0-7254-4cf6-9a16-816a6b6f3368', '1fe7de7b-d65d-4cb6-b948-d1a1bfc1d218', '9d56a50b-1f7d-4209-a681-d5c2ae4d66b2', '66f918a4-5855-4188-871a-a21a995caf9f'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:52:32 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] Delete snapshot completed successfully. Jun 02 00:52:32 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-11eb1336-6c10-4d10-8b46-771e272fd739 tempest-TestStampPattern-2014827699 None] Lock "cinder-07d882d0-b0f9-4a7f-ba8b-8939f23ae1fe-delete_snapshot" released by "delete_snapshot" :: held 2.857s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:52:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] Acquiring lock "cinder-ed1904ea-23f9-45e5-9a52-05be8447cdc8-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:52:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] Lock "cinder-ed1904ea-23f9-45e5-9a52-05be8447cdc8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:52:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] Acquiring lock "cinder-quobyte-ed1904ea-23f9-45e5-9a52-05be8447cdc8" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:52:39 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] Lock "cinder-quobyte-ed1904ea-23f9-45e5-9a52-05be8447cdc8" acquired by "delete_volume" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:52:39 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a2f73e-f143-4f63-9415-d327fcb61f65]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:52:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:39 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 Jun 02 00:52:39 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:40 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8" returned: 0 in 0.691s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:40 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8 Jun 02 00:52:40 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:41 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ed1904ea-23f9-45e5-9a52-05be8447cdc8" returned: 0 in 0.589s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] Lock "cinder-quobyte-ed1904ea-23f9-45e5-9a52-05be8447cdc8" released by "delete_volume" :: held 1.339s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:52:41 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] Created reservations ['6cab240d-9679-413e-b225-90231a69c5a2', 'b659a42c-06b7-45b3-88f0-0aae6a5101ee', '593e6016-d80f-4ff9-bceb-d3b340129fec', 'fe020c41-23ed-4af2-8483-c9e8802c831e'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:52:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:52:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:52:41 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:52:41 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:52:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:52:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:41 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:52:41 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:41 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.605s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:41 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:52:41 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] Deleted volume successfully. Jun 02 00:52:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-2f254207-e352-4e15-840f-eb4125c45ff7 tempest-TestStampPattern-2014827699 None] Lock "cinder-ed1904ea-23f9-45e5-9a52-05be8447cdc8-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=27,cinder:SELECT=19,cinder:INSERT=7 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Flow 'volume_create_manager' (00c78146-203a-470e-8c6f-66801894e25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b5e120-6815-43d7-aecd-4fb0bd002a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b5e120-6815-43d7-aecd-4fb0bd002a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-527933531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1467bfd-49c0-4a67-bed8-27d1f9758152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef9dde134784246bbfc2aba34c6fd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:52:51Z,use_quota=True,user_id='33bdfd4a3c074edf865989c8672881ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57232255-8d87-4076-a115-ccbabd96a5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57232255-8d87-4076-a115-ccbabd96a5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbc0c0c-34e5-4d11-bf1b-b72824e8e70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbc0c0c-34e5-4d11-bf1b-b72824e8e70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1467bfd-49c0-4a67-bed8-27d1f9758152', 'volume_name': 'volume-c1467bfd-49c0-4a67-bed8-27d1f9758152', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9863f2-9f3f-4b76-abf2-dfe569f6eac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9863f2-9f3f-4b76-abf2-dfe569f6eac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272ed687-3d2e-45d8-9f02-0b68fa3ad347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:51 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Volume c1467bfd-49c0-4a67-bed8-27d1f9758152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1467bfd-49c0-4a67-bed8-27d1f9758152', 'volume_size': 1} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-527933531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1467bfd-49c0-4a67-bed8-27d1f9758152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef9dde134784246bbfc2aba34c6fd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:52:51Z,use_quota=True,user_id='33bdfd4a3c074edf865989c8672881ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Creating volume c1467bfd-49c0-4a67-bed8-27d1f9758152 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:52:51 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c1467bfd-49c0-4a67-bed8-27d1f9758152 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:51 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c1467bfd-49c0-4a67-bed8-27d1f9758152 1073741824 Jun 02 00:52:51 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Flow 'volume_create_manager' (6ac20a5e-61be-431d-a296-0eba6d3a41b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac2ffe3-6a49-4a51-af69-7ca4c91dd41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac2ffe3-6a49-4a51-af69-7ca4c91dd41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-657985361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5651830-37e2-4355-a887-b829c5f946db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef9dde134784246bbfc2aba34c6fd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:52:52Z,use_quota=True,user_id='33bdfd4a3c074edf865989c8672881ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb3e0ee-0692-4cba-afe3-ecf097286b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb3e0ee-0692-4cba-afe3-ecf097286b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d653a78-b6c2-45cd-9ad0-65934d523949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d653a78-b6c2-45cd-9ad0-65934d523949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5651830-37e2-4355-a887-b829c5f946db', 'volume_name': 'volume-f5651830-37e2-4355-a887-b829c5f946db', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ea2af9-709e-4437-932f-955c74d187a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ea2af9-709e-4437-932f-955c74d187a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9262bd7-9a73-48f4-8edf-03aa18241f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:51 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Volume f5651830-37e2-4355-a887-b829c5f946db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5651830-37e2-4355-a887-b829c5f946db', 'volume_size': 1} Jun 02 00:52:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Flow 'volume_create_manager' (7e992dd6-6264-45a9-b371-7f7d639dd04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bdecba3-bf55-4aec-bd37-ad39ed728296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bdecba3-bf55-4aec-bd37-ad39ed728296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-728761582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2af6cb3-7602-421a-be65-73dcb5cecd76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef9dde134784246bbfc2aba34c6fd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:52:52Z,use_quota=True,user_id='33bdfd4a3c074edf865989c8672881ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0f1e9f-ed93-4534-bd5e-33b8e8185e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0f1e9f-ed93-4534-bd5e-33b8e8185e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcac691e-7f4a-44ef-8c8e-056ffeba4992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcac691e-7f4a-44ef-8c8e-056ffeba4992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2af6cb3-7602-421a-be65-73dcb5cecd76', 'volume_name': 'volume-e2af6cb3-7602-421a-be65-73dcb5cecd76', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d842858c-6e71-4071-af99-dbcefa6e3e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d842858c-6e71-4071-af99-dbcefa6e3e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99640ac3-c5a1-43cb-8731-6b973a6d590f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:52 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Volume e2af6cb3-7602-421a-be65-73dcb5cecd76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2af6cb3-7602-421a-be65-73dcb5cecd76', 'volume_size': 1} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:52:52 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c1467bfd-49c0-4a67-bed8-27d1f9758152 1073741824" returned: 0 in 0.823s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c1467bfd-49c0-4a67-bed8-27d1f9758152 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:52 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c1467bfd-49c0-4a67-bed8-27d1f9758152 Jun 02 00:52:52 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Flow 'volume_create_manager' (748d1b17-426c-40d1-ac12-9da0c518f069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d374c5-6fc5-427f-9de6-a9f48351a42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d374c5-6fc5-427f-9de6-a9f48351a42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-359214810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d93c27-8d96-42c4-8aa4-cac30008ba46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef9dde134784246bbfc2aba34c6fd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:52:52Z,use_quota=True,user_id='33bdfd4a3c074edf865989c8672881ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430fccc1-51f4-4762-839a-c38e20cac122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430fccc1-51f4-4762-839a-c38e20cac122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b6e852-c38d-42a0-b6df-d230897c8995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b6e852-c38d-42a0-b6df-d230897c8995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32d93c27-8d96-42c4-8aa4-cac30008ba46', 'volume_name': 'volume-32d93c27-8d96-42c4-8aa4-cac30008ba46', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2c7303-9247-4f29-a137-e24c7e221567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2c7303-9247-4f29-a137-e24c7e221567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ba9747-b0cb-4692-8ac1-eb617ff3894f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:52 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Volume 32d93c27-8d96-42c4-8aa4-cac30008ba46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32d93c27-8d96-42c4-8aa4-cac30008ba46', 'volume_size': 1} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Flow 'volume_create_manager' (a3f476bd-36a3-4b45-ba54-5d77ec720105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0c8cd1-77c6-4b67-ba82-b6edbd51028c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0c8cd1-77c6-4b67-ba82-b6edbd51028c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2034278855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba0bbd4-87b0-4b88-a0ec-a481e4059e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef9dde134784246bbfc2aba34c6fd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:52:53Z,use_quota=True,user_id='33bdfd4a3c074edf865989c8672881ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee3a403-9fa9-40c6-85bf-1c3c6aa7c1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee3a403-9fa9-40c6-85bf-1c3c6aa7c1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c963e6-22ed-489b-bb4c-c6f124bfdbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c963e6-22ed-489b-bb4c-c6f124bfdbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ba0bbd4-87b0-4b88-a0ec-a481e4059e26', 'volume_name': 'volume-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b793552-d815-47ab-87e7-225976d83021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b793552-d815-47ab-87e7-225976d83021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd8d646-42b6-48b7-8664-0d5c6736f6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:52 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Volume 2ba0bbd4-87b0-4b88-a0ec-a481e4059e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26', 'volume_size': 1} Jun 02 00:52:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:52:53 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c1467bfd-49c0-4a67-bed8-27d1f9758152" returned: 0 in 0.629s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.154s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-657985361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5651830-37e2-4355-a887-b829c5f946db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef9dde134784246bbfc2aba34c6fd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:52:52Z,use_quota=True,user_id='33bdfd4a3c074edf865989c8672881ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Creating volume f5651830-37e2-4355-a887-b829c5f946db {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:52:53 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f5651830-37e2-4355-a887-b829c5f946db 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272ed687-3d2e-45d8-9f02-0b68fa3ad347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1467bfd-49c0-4a67-bed8-27d1f9758152', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:53 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f5651830-37e2-4355-a887-b829c5f946db 1073741824 Jun 02 00:52:53 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5b65ba-3833-4333-af51-4440b5b7bbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:53 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Volume volume-c1467bfd-49c0-4a67-bed8-27d1f9758152 (c1467bfd-49c0-4a67-bed8-27d1f9758152): created successfully Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5b65ba-3833-4333-af51-4440b5b7bbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Flow 'volume_create_manager' (00c78146-203a-470e-8c6f-66801894e25e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:52:53 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-88bcd53e-39a3-4a97-99c0-d3b2c4bdf9a3 tempest-CreateVolumesFromImageTest-664766253 None] Created volume successfully. Jun 02 00:52:53 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f5651830-37e2-4355-a887-b829c5f946db 1073741824" returned: 0 in 0.763s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f5651830-37e2-4355-a887-b829c5f946db {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:53 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f5651830-37e2-4355-a887-b829c5f946db Jun 02 00:52:53 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:54 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f5651830-37e2-4355-a887-b829c5f946db" returned: 0 in 0.584s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:52:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:52:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.223s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:52:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-728761582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2af6cb3-7602-421a-be65-73dcb5cecd76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef9dde134784246bbfc2aba34c6fd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:52:52Z,use_quota=True,user_id='33bdfd4a3c074edf865989c8672881ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:52:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Creating volume e2af6cb3-7602-421a-be65-73dcb5cecd76 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:52:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:52:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:52:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:52:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:52:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:52:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:52:54 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:52:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e2af6cb3-7602-421a-be65-73dcb5cecd76 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9262bd7-9a73-48f4-8edf-03aa18241f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5651830-37e2-4355-a887-b829c5f946db', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:54 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e2af6cb3-7602-421a-be65-73dcb5cecd76 1073741824 Jun 02 00:52:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0fceba-3b5f-4d09-9d06-9d0ac7e19e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:54 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:54 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Volume volume-f5651830-37e2-4355-a887-b829c5f946db (f5651830-37e2-4355-a887-b829c5f946db): created successfully Jun 02 00:52:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0fceba-3b5f-4d09-9d06-9d0ac7e19e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Flow 'volume_create_manager' (6ac20a5e-61be-431d-a296-0eba6d3a41b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:52:54 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-958334e9-e88d-409f-9c12-308cf8cc7e3a tempest-CreateVolumesFromImageTest-664766253 None] Created volume successfully. Jun 02 00:52:55 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e2af6cb3-7602-421a-be65-73dcb5cecd76 1073741824" returned: 0 in 0.778s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e2af6cb3-7602-421a-be65-73dcb5cecd76 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:55 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e2af6cb3-7602-421a-be65-73dcb5cecd76 Jun 02 00:52:55 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:55 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e2af6cb3-7602-421a-be65-73dcb5cecd76" returned: 0 in 0.586s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.267s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-359214810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d93c27-8d96-42c4-8aa4-cac30008ba46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef9dde134784246bbfc2aba34c6fd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:52:52Z,use_quota=True,user_id='33bdfd4a3c074edf865989c8672881ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Creating volume 32d93c27-8d96-42c4-8aa4-cac30008ba46 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:52:55 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-32d93c27-8d96-42c4-8aa4-cac30008ba46 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:55 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-32d93c27-8d96-42c4-8aa4-cac30008ba46 1073741824 Jun 02 00:52:55 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99640ac3-c5a1-43cb-8731-6b973a6d590f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2af6cb3-7602-421a-be65-73dcb5cecd76', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7643bb-298e-464c-9e1a-34ea287104a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:55 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Volume volume-e2af6cb3-7602-421a-be65-73dcb5cecd76 (e2af6cb3-7602-421a-be65-73dcb5cecd76): created successfully Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7643bb-298e-464c-9e1a-34ea287104a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Flow 'volume_create_manager' (7e992dd6-6264-45a9-b371-7f7d639dd04f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:52:55 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-4b344c30-081e-4805-a1b6-0b6e2f558b52 tempest-CreateVolumesFromImageTest-664766253 None] Created volume successfully. Jun 02 00:52:56 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-32d93c27-8d96-42c4-8aa4-cac30008ba46 1073741824" returned: 0 in 0.748s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-32d93c27-8d96-42c4-8aa4-cac30008ba46 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:56 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-32d93c27-8d96-42c4-8aa4-cac30008ba46 Jun 02 00:52:56 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:57 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-32d93c27-8d96-42c4-8aa4-cac30008ba46" returned: 0 in 0.596s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:52:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:52:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.324s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:52:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2034278855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba0bbd4-87b0-4b88-a0ec-a481e4059e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef9dde134784246bbfc2aba34c6fd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:52:53Z,use_quota=True,user_id='33bdfd4a3c074edf865989c8672881ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:52:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Creating volume 2ba0bbd4-87b0-4b88-a0ec-a481e4059e26 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:52:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:52:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:52:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:52:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:52:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:52:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:52:57 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:52:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ba9747-b0cb-4692-8ac1-eb617ff3894f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d93c27-8d96-42c4-8aa4-cac30008ba46', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:57 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26 1073741824 Jun 02 00:52:57 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f77fb7b-1b5a-4c73-9fa8-1f794fd6b39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:57 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Volume volume-32d93c27-8d96-42c4-8aa4-cac30008ba46 (32d93c27-8d96-42c4-8aa4-cac30008ba46): created successfully Jun 02 00:52:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f77fb7b-1b5a-4c73-9fa8-1f794fd6b39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:57 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Flow 'volume_create_manager' (748d1b17-426c-40d1-ac12-9da0c518f069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:52:57 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-8fd2312c-bcda-4d7f-a96c-747197038d19 tempest-CreateVolumesFromImageTest-664766253 None] Created volume successfully. Jun 02 00:52:58 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26 1073741824" returned: 0 in 0.758s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:58 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26 Jun 02 00:52:58 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:52:58 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jun 02 00:52:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26" returned: 0 in 0.599s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:52:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:52:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:52:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd8d646-42b6-48b7-8664-0d5c6736f6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685c3360-4137-49bd-92cc-00a30bd2b6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:52:58 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Volume volume-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26 (2ba0bbd4-87b0-4b88-a0ec-a481e4059e26): created successfully Jun 02 00:52:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685c3360-4137-49bd-92cc-00a30bd2b6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:52:58 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Flow 'volume_create_manager' (a3f476bd-36a3-4b45-ba54-5d77ec720105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:52:58 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-c2e186e4-bf63-4076-b4a6-63ea59f2641f tempest-CreateVolumesFromImageTest-664766253 None] Created volume successfully. Jun 02 00:52:59 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "cinder-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:52:59 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:52:59 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "cinder-quobyte-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:52:59 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-quobyte-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26" acquired by "delete_volume" :: waited 0.012s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:52:59 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f427daf2-c281-44e7-9513-8f984884c785]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:52:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:52:59 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26 Jun 02 00:52:59 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:00 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26" returned: 0 in 0.708s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:00 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26 Jun 02 00:53:00 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:00 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26" returned: 0 in 0.586s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-quobyte-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26" released by "delete_volume" :: held 1.333s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:00 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] Created reservations ['a59ebb91-a389-4eb2-bfbe-cfb71e6e531e', '75897cb8-b519-42ac-996b-5cd02acd2ea2', '8f5db55b-c879-4a36-863d-fa63579f07be', 'cd23cb2f-78dd-44d6-98f9-0a87da0716f8'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:53:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:00 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:53:00 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:01 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.590s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:01 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:53:01 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] Deleted volume successfully. Jun 02 00:53:01 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=40,cinder:UPDATE=43,cinder:INSERT=9,cinder:DELETE=5 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:53:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-55aea189-faea-488a-b8a1-1e88812438a4 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-2ba0bbd4-87b0-4b88-a0ec-a481e4059e26-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "cinder-32d93c27-8d96-42c4-8aa4-cac30008ba46-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-32d93c27-8d96-42c4-8aa4-cac30008ba46-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "cinder-quobyte-32d93c27-8d96-42c4-8aa4-cac30008ba46" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-quobyte-32d93c27-8d96-42c4-8aa4-cac30008ba46" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:01 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d5f568-6f62-473e-afed-28cbb5473f3a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:53:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-32d93c27-8d96-42c4-8aa4-cac30008ba46 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:01 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-32d93c27-8d96-42c4-8aa4-cac30008ba46 Jun 02 00:53:01 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:02 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-32d93c27-8d96-42c4-8aa4-cac30008ba46" returned: 0 in 0.705s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-32d93c27-8d96-42c4-8aa4-cac30008ba46 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:02 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-32d93c27-8d96-42c4-8aa4-cac30008ba46 Jun 02 00:53:02 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:03 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-32d93c27-8d96-42c4-8aa4-cac30008ba46" returned: 0 in 0.589s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-quobyte-32d93c27-8d96-42c4-8aa4-cac30008ba46" released by "delete_volume" :: held 1.333s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] Created reservations ['f4405b8d-0db4-4210-b90d-b2e1d50d58f2', '87595da3-7e72-443d-8f8e-a3f6bbec480b', '8e0c18db-a221-4c7f-a1b0-875394930a40', '8516e698-4ec6-440d-832b-874b7be29a68'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:03 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:53:03 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:03 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.604s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:53:03 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] Deleted volume successfully. Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-22d5e67c-24ac-4ce0-8e09-a209331f8eb2 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-32d93c27-8d96-42c4-8aa4-cac30008ba46-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "cinder-e2af6cb3-7602-421a-be65-73dcb5cecd76-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-e2af6cb3-7602-421a-be65-73dcb5cecd76-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "cinder-quobyte-e2af6cb3-7602-421a-be65-73dcb5cecd76" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-quobyte-e2af6cb3-7602-421a-be65-73dcb5cecd76" acquired by "delete_volume" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cc187d-7883-4c0b-80cb-0966562b6940]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:53:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e2af6cb3-7602-421a-be65-73dcb5cecd76 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:04 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e2af6cb3-7602-421a-be65-73dcb5cecd76 Jun 02 00:53:04 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:04 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e2af6cb3-7602-421a-be65-73dcb5cecd76" returned: 0 in 0.698s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e2af6cb3-7602-421a-be65-73dcb5cecd76 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:04 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e2af6cb3-7602-421a-be65-73dcb5cecd76 Jun 02 00:53:04 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:05 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-e2af6cb3-7602-421a-be65-73dcb5cecd76" returned: 0 in 0.604s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-quobyte-e2af6cb3-7602-421a-be65-73dcb5cecd76" released by "delete_volume" :: held 1.340s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:05 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] Created reservations ['58859c4d-e005-4aa4-8140-57fd1a10a885', '8c276bb3-0122-4188-a332-9dafabd4ace4', 'ea5a3d17-c047-4a77-b09d-7a779d107a05', 'e517450d-6169-4d93-a29f-6a92c8c87e40'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:53:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:05 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:05 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:53:05 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:05 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.582s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:05 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:53:05 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] Deleted volume successfully. Jun 02 00:53:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-139ed16a-90c3-4ea2-a90a-cfd00bfa1a50 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-e2af6cb3-7602-421a-be65-73dcb5cecd76-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:06 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "cinder-f5651830-37e2-4355-a887-b829c5f946db-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:06 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-f5651830-37e2-4355-a887-b829c5f946db-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:06 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "cinder-quobyte-f5651830-37e2-4355-a887-b829c5f946db" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:06 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-quobyte-f5651830-37e2-4355-a887-b829c5f946db" acquired by "delete_volume" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:06 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[20139c65-b2f3-4463-892f-765632d3f510]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:53:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f5651830-37e2-4355-a887-b829c5f946db {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:06 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f5651830-37e2-4355-a887-b829c5f946db Jun 02 00:53:06 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:06 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f5651830-37e2-4355-a887-b829c5f946db" returned: 0 in 0.688s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f5651830-37e2-4355-a887-b829c5f946db {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:06 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f5651830-37e2-4355-a887-b829c5f946db Jun 02 00:53:06 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:07 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f5651830-37e2-4355-a887-b829c5f946db" returned: 0 in 0.575s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-quobyte-f5651830-37e2-4355-a887-b829c5f946db" released by "delete_volume" :: held 1.301s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:07 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] Created reservations ['a1ae5282-12d8-4b17-b9f8-4f84a1326458', 'ba533f4c-901a-410d-859b-8036039585bd', 'e26b6174-bc82-4560-803e-8b0885bd690f', '3661ae86-e81c-4130-9f26-14067358f4bf'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:53:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:07 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:53:07 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:08 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.589s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:08 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:53:08 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] Deleted volume successfully. Jun 02 00:53:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-91cc697e-91b6-4d92-802d-bf5f75dc1ce8 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-f5651830-37e2-4355-a887-b829c5f946db-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "cinder-c1467bfd-49c0-4a67-bed8-27d1f9758152-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-c1467bfd-49c0-4a67-bed8-27d1f9758152-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "cinder-quobyte-c1467bfd-49c0-4a67-bed8-27d1f9758152" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-quobyte-c1467bfd-49c0-4a67-bed8-27d1f9758152" acquired by "delete_volume" :: waited 0.016s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:08 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaec3ec-1da2-4dec-ace6-42d605f46930]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:53:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c1467bfd-49c0-4a67-bed8-27d1f9758152 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:08 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c1467bfd-49c0-4a67-bed8-27d1f9758152 Jun 02 00:53:08 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:09 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c1467bfd-49c0-4a67-bed8-27d1f9758152" returned: 0 in 0.684s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c1467bfd-49c0-4a67-bed8-27d1f9758152 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:09 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c1467bfd-49c0-4a67-bed8-27d1f9758152 Jun 02 00:53:09 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:09 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-c1467bfd-49c0-4a67-bed8-27d1f9758152" returned: 0 in 0.586s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:09 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-quobyte-c1467bfd-49c0-4a67-bed8-27d1f9758152" released by "delete_volume" :: held 1.310s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:09 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] Created reservations ['51413e1f-ebd7-4860-804a-d0cd3c7dcf75', 'd39ea721-a1dd-44b1-895c-68bb574c1ffc', '90451d37-0684-4822-adf3-7dea493d4cc1', 'c0789e9c-2132-4894-bfac-a0636412ab44'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:53:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:09 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:09 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:09 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:53:09 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:10 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.598s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:10 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:53:10 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] Deleted volume successfully. Jun 02 00:53:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-355160de-a412-4680-bbcf-875eb6db1138 tempest-CreateVolumesFromImageTest-664766253 None] Lock "cinder-c1467bfd-49c0-4a67-bed8-27d1f9758152-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:15 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:53:15 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:15 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.613s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Flow 'volume_create_manager' (e57ea77b-e479-4622-b4f4-02150b9c2bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c17ab91-9e78-459c-a17a-f9beae0b5fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c17ab91-9e78-459c-a17a-f9beae0b5fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acbdf6a-eef2-41ae-98dd-71c62d28f3ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddb70dc6b3e4a21bb85677b8eee4a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:16Z,use_quota=True,user_id='a23c68689eb9487a930a99c3df24333c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9be8f7-4625-4679-8acb-29ed38627b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9be8f7-4625-4679-8acb-29ed38627b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21316b7-2368-45b8-86f1-52bdffd0c531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21316b7-2368-45b8-86f1-52bdffd0c531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4acbdf6a-eef2-41ae-98dd-71c62d28f3ab', 'volume_name': 'volume-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e34d3d-bb4f-45fc-ad17-1c04b16fe61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e34d3d-bb4f-45fc-ad17-1c04b16fe61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9c95da-faf9-4ac1-a2f1-fa23ac324772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:15 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Volume 4acbdf6a-eef2-41ae-98dd-71c62d28f3ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab', 'volume_size': 1} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acbdf6a-eef2-41ae-98dd-71c62d28f3ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddb70dc6b3e4a21bb85677b8eee4a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:16Z,use_quota=True,user_id='a23c68689eb9487a930a99c3df24333c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Creating volume 4acbdf6a-eef2-41ae-98dd-71c62d28f3ab {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:53:15 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:53:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:15 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab 1073741824 Jun 02 00:53:15 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:16 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab 1073741824" returned: 0 in 0.739s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:16 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab Jun 02 00:53:16 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:17 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab" returned: 0 in 0.577s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:17 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:53:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9c95da-faf9-4ac1-a2f1-fa23ac324772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e722320e-138a-4dce-9cf4-68ae5837968e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:17 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Volume volume-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab (4acbdf6a-eef2-41ae-98dd-71c62d28f3ab): created successfully Jun 02 00:53:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e722320e-138a-4dce-9cf4-68ae5837968e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Flow 'volume_create_manager' (e57ea77b-e479-4622-b4f4-02150b9c2bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:17 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-04fac3d8-9783-459f-938f-baaf4b21d5b5 tempest-CinderUnicodeTest-909359621 None] Created volume successfully. Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Flow 'volume_create_manager' (e03d0b6c-ceca-4fd2-bdbb-50eef4b7e0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d10a046-5ce1-46d8-8452-e766c424fb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d10a046-5ce1-46d8-8452-e766c424fb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1435177671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c628b6-9672-4245-b0fb-6ad279ec9aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddb70dc6b3e4a21bb85677b8eee4a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:18Z,use_quota=True,user_id='a23c68689eb9487a930a99c3df24333c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b260d328-9722-48ff-9736-4f5d33279165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b260d328-9722-48ff-9736-4f5d33279165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ba5d2e-900d-48ac-be6d-b0ea62130035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ba5d2e-900d-48ac-be6d-b0ea62130035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29c628b6-9672-4245-b0fb-6ad279ec9aa8', 'volume_name': 'volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc9e0cf-55b0-4121-98be-7d13cde3374c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc9e0cf-55b0-4121-98be-7d13cde3374c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaacd37-a480-4841-8ef2-563e814339b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:18 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Volume 29c628b6-9672-4245-b0fb-6ad279ec9aa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8', 'volume_size': 1} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1435177671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c628b6-9672-4245-b0fb-6ad279ec9aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddb70dc6b3e4a21bb85677b8eee4a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:18Z,use_quota=True,user_id='a23c68689eb9487a930a99c3df24333c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Creating volume 29c628b6-9672-4245-b0fb-6ad279ec9aa8 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:53:18 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:53:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:18 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8 1073741824 Jun 02 00:53:18 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:19 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8 1073741824" returned: 0 in 0.776s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:19 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8 Jun 02 00:53:19 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:19 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8" returned: 0 in 0.577s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:53:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaacd37-a480-4841-8ef2-563e814339b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27aa844a-fc9f-4ddf-bbae-025c26c9d184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:19 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Volume volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8 (29c628b6-9672-4245-b0fb-6ad279ec9aa8): created successfully Jun 02 00:53:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27aa844a-fc9f-4ddf-bbae-025c26c9d184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:19 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Flow 'volume_create_manager' (e03d0b6c-ceca-4fd2-bdbb-50eef4b7e0c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:20 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-7e1bdaa8-fad9-4345-a4aa-ed30638dc0bb tempest-CinderUnicodeTest-909359621 None] Created volume successfully. Jun 02 00:53:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:20 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] Creating offline snapshot 75d5312b-bd18-4058-8bae-3081c990456b of volume 29c628b6-9672-4245-b0fb-6ad279ec9aa8 {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:53:20 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[354327c4-d054-4cca-87ec-25ce48889461]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:53:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:20 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8 Jun 02 00:53:20 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:21 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8" returned: 0 in 0.692s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:21 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b 1G Jun 02 00:53:21 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:22 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b 1G" returned: 0 in 0.721s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:22 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b Jun 02 00:53:22 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:22 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b" returned: 0 in 0.615s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:22 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b is being set with open permissions: ugo+rw Jun 02 00:53:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:22 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b Jun 02 00:53:22 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:23 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b" returned: 0 in 0.573s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:23 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.info Jun 02 00:53:23 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:23 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.info" returned: 0 in 0.573s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:23 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.info is being set with open permissions: ugo+rw Jun 02 00:53:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:23 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.info Jun 02 00:53:23 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:24 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.info" returned: 0 in 0.589s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.842s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:24 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-477d3b20-1155-44bc-98d6-d1763b7cb026 tempest-CinderUnicodeTest-909359621 None] Create snapshot completed successfully Jun 02 00:53:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] Acquiring lock "cinder-75d5312b-bd18-4058-8bae-3081c990456b-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] Lock "cinder-75d5312b-bd18-4058-8bae-3081c990456b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] Acquiring lock "cinder-quobyte-29c628b6-9672-4245-b0fb-6ad279ec9aa8" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] Lock "cinder-quobyte-29c628b6-9672-4245-b0fb-6ad279ec9aa8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] Acquiring lock "cinder-quobyte-75d5312b-bd18-4058-8bae-3081c990456b" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:24 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] Lock "cinder-quobyte-75d5312b-bd18-4058-8bae-3081c990456b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] Deleting offline snapshot 75d5312b-bd18-4058-8bae-3081c990456b of volume 29c628b6-9672-4245-b0fb-6ad279ec9aa8 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:53:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] snapshot_file for this snap is: volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:53:24 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[302bd6ac-c895-410d-a226-b37382ea4613]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:53:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:25 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b Jun 02 00:53:25 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:25 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b" returned: 0 in 0.693s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:53:25 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc43bc7-51e9-4ed8-9c79-b007a679cd50]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:53:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:25 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8 Jun 02 00:53:25 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:26 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8" returned: 0 in 0.699s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:26 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b Jun 02 00:53:26 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:27 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b" returned: 0 in 0.692s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:27 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b Jun 02 00:53:27 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:27 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8.75d5312b-bd18-4058-8bae-3081c990456b" returned: 0 in 0.570s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] Lock "cinder-quobyte-75d5312b-bd18-4058-8bae-3081c990456b" released by "_delete_snapshot" :: held 2.747s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] Lock "cinder-quobyte-29c628b6-9672-4245-b0fb-6ad279ec9aa8" released by "delete_snapshot" :: held 2.766s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:27 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] Created reservations ['1f764257-c1f5-43d1-963c-7a0c22da966e', 'a990788b-f6e7-4772-a3d6-6add96c3b5f8', '9ac21b50-e133-4e3d-bab6-111c147bf073', '5eb9ddfb-5dca-4088-ae5c-e70b3487bf15'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:53:27 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] Delete snapshot completed successfully. Jun 02 00:53:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-50b6c249-f852-4038-983e-cab620d4af73 tempest-CinderUnicodeTest-909359621 None] Lock "cinder-75d5312b-bd18-4058-8bae-3081c990456b-delete_snapshot" released by "delete_snapshot" :: held 2.883s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] Acquiring lock "cinder-29c628b6-9672-4245-b0fb-6ad279ec9aa8-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] Lock "cinder-29c628b6-9672-4245-b0fb-6ad279ec9aa8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] Acquiring lock "cinder-quobyte-29c628b6-9672-4245-b0fb-6ad279ec9aa8" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] Lock "cinder-quobyte-29c628b6-9672-4245-b0fb-6ad279ec9aa8" acquired by "delete_volume" :: waited 0.013s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:28 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f4c46c-1e6d-4139-8961-c2cbd2fbe30a]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:53:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:28 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8 Jun 02 00:53:28 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:28 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8" returned: 0 in 0.691s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:28 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8 Jun 02 00:53:28 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:29 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-29c628b6-9672-4245-b0fb-6ad279ec9aa8" returned: 0 in 0.575s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] Lock "cinder-quobyte-29c628b6-9672-4245-b0fb-6ad279ec9aa8" released by "delete_volume" :: held 1.321s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:29 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] Created reservations ['4934462a-b861-4d35-a384-8ff10a800e88', '368db9b1-d705-4542-a646-44b8c05d7875', 'f51cfb8d-ac06-4a98-aac2-9d1885822fec', 'e377cd6b-6a2a-4074-add0-37cc43d396eb'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:53:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:29 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:29 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:29 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:53:29 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:30 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.603s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:30 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:53:30 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] Deleted volume successfully. Jun 02 00:53:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f0485232-1330-4cc0-910a-fe6d5c0c6d19 tempest-CinderUnicodeTest-909359621 None] Lock "cinder-29c628b6-9672-4245-b0fb-6ad279ec9aa8-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] Acquiring lock "cinder-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] Lock "cinder-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] Acquiring lock "cinder-quobyte-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:30 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] Lock "cinder-quobyte-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab" acquired by "delete_volume" :: waited 0.013s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:30 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[802cf695-6420-42b6-804d-6af137aa3572]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:53:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:30 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab Jun 02 00:53:30 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:31 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab" returned: 0 in 0.704s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:31 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab Jun 02 00:53:31 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:31 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab" returned: 0 in 0.589s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:31 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] Lock "cinder-quobyte-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab" released by "delete_volume" :: held 1.330s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:31 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] Created reservations ['6bf70f58-64ec-4baf-a421-398bc90f51bc', '954f203e-8f17-49e8-a45b-7e097e46adfb', '61c25e43-a410-4c82-b98b-ebb5940317b2', 'f36385a1-3f5e-4af4-9a5f-19b7b6213b20'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:53:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:31 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:31 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:31 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:31 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:53:31 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:32 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.592s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:32 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:53:32 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] Deleted volume successfully. Jun 02 00:53:32 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-46ad60f3-9de8-4bc2-b7d5-4b7ec1f43e4a tempest-CinderUnicodeTest-909359621 None] Lock "cinder-4acbdf6a-eef2-41ae-98dd-71c62d28f3ab-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:41 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=42,cinder:INSERT=14,cinder:UPDATE=61,cinder:DELETE=6 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:53:42 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=60,cinder:UPDATE=84,cinder:DELETE=6,cinder:INSERT=22 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:53:43 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:53:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Flow 'volume_create_manager' (8bae1cd0-7afb-45f8-86bb-4d58467eb16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b989f0-b13b-464f-a304-dc911a36fa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b989f0-b13b-464f-a304-dc911a36fa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=021e2585-d92c-4011-849e-b72d0068e515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1b8be90ce0420e8d6cdf46c36f17f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:44Z,use_quota=True,user_id='6934f065197a478597880f0dbc913de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957fc6a4-9091-4e8b-8595-1974bcda7457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957fc6a4-9091-4e8b-8595-1974bcda7457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a9c7c9b-9143-4930-a7e5-aa81dceee1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a9c7c9b-9143-4930-a7e5-aa81dceee1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '021e2585-d92c-4011-849e-b72d0068e515', 'volume_name': 'volume-021e2585-d92c-4011-849e-b72d0068e515', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e60d63-0f39-460f-a0e7-4f303dc86da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e60d63-0f39-460f-a0e7-4f303dc86da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec80c6cb-6790-4212-a38e-65584eec52d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:44 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Volume 021e2585-d92c-4011-849e-b72d0068e515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-021e2585-d92c-4011-849e-b72d0068e515', 'volume_size': 1} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=021e2585-d92c-4011-849e-b72d0068e515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1b8be90ce0420e8d6cdf46c36f17f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:44Z,use_quota=True,user_id='6934f065197a478597880f0dbc913de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Creating volume 021e2585-d92c-4011-849e-b72d0068e515 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:53:44 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-021e2585-d92c-4011-849e-b72d0068e515 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:44 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-021e2585-d92c-4011-849e-b72d0068e515 1073741824 Jun 02 00:53:44 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Flow 'volume_create_manager' (5e00ed6f-4f5c-463e-8b23-22491ef0b423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc2c903-3674-4e1d-a2d7-170143e6895c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc2c903-3674-4e1d-a2d7-170143e6895c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1353576611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178cc536-6328-4d88-a4bc-aec3c26d3919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af625098be4f259be24a358102226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:44Z,use_quota=True,user_id='640396ffb81141aa8dd4cf762c6e964e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2631870-239a-4ab8-b918-a856a0aff35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2631870-239a-4ab8-b918-a856a0aff35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84364bf-ee8b-4135-9383-066a99251e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84364bf-ee8b-4135-9383-066a99251e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '178cc536-6328-4d88-a4bc-aec3c26d3919', 'volume_name': 'volume-178cc536-6328-4d88-a4bc-aec3c26d3919', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e7e99c-5e4b-498f-859a-715a2e029637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e7e99c-5e4b-498f-859a-715a2e029637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b555c69-b3b2-4b4e-a3b2-5fa222f0a5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:44 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Volume 178cc536-6328-4d88-a4bc-aec3c26d3919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-178cc536-6328-4d88-a4bc-aec3c26d3919', 'volume_size': 1} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Flow 'volume_create_manager' (263e7739-b9ea-4651-8ac2-d21e89a26090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1264c1a-4084-4088-acf6-183ce0d14b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1264c1a-4084-4088-acf6-183ce0d14b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1551893095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bff803e-0173-43bb-8730-13a7b4254f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af625098be4f259be24a358102226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:45Z,use_quota=True,user_id='640396ffb81141aa8dd4cf762c6e964e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5081d58-7848-4aae-9935-16afc494d3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5081d58-7848-4aae-9935-16afc494d3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88eb6c5-ad50-4e7c-bc61-50b75d088a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88eb6c5-ad50-4e7c-bc61-50b75d088a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bff803e-0173-43bb-8730-13a7b4254f74', 'volume_name': 'volume-3bff803e-0173-43bb-8730-13a7b4254f74', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bfcd3b-555d-4f8f-8550-1c1a5d7bfb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bfcd3b-555d-4f8f-8550-1c1a5d7bfb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e0b857-cdc6-422d-9707-d3e174d01cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:44 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Volume 3bff803e-0173-43bb-8730-13a7b4254f74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bff803e-0173-43bb-8730-13a7b4254f74', 'volume_size': 1} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Flow 'volume_create_manager' (4e38b60a-4b2a-401e-859c-f8bef2f95c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8681f086-22eb-42ef-9100-077cf75e9116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8681f086-22eb-42ef-9100-077cf75e9116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-81481313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b69d25-aec4-452d-81fc-59ee395693f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dca3deb9ce64f629c2e359723d49f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:45Z,use_quota=True,user_id='5cb38450cb4d4a6391a3ad213150cf8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed76818-d0d7-4ba9-8e4f-102f1eab98d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed76818-d0d7-4ba9-8e4f-102f1eab98d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a695e2d-c5de-4fbd-a297-d5cad43fc314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a695e2d-c5de-4fbd-a297-d5cad43fc314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b69d25-aec4-452d-81fc-59ee395693f3', 'volume_name': 'volume-a8b69d25-aec4-452d-81fc-59ee395693f3', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac68baee-4175-4e9c-b1ff-adfb9f3129bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac68baee-4175-4e9c-b1ff-adfb9f3129bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c8ec8e-613a-441e-a4eb-0cee52cff3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:44 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume a8b69d25-aec4-452d-81fc-59ee395693f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b69d25-aec4-452d-81fc-59ee395693f3', 'volume_size': 1} Jun 02 00:53:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:45 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-021e2585-d92c-4011-849e-b72d0068e515 1073741824" returned: 0 in 1.159s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Flow 'volume_create_manager' (fa8473a2-f752-4845-b4b8-18ce99ea2a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1c7c83-51b3-4872-984e-6de9873d909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-021e2585-d92c-4011-849e-b72d0068e515 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1c7c83-51b3-4872-984e-6de9873d909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-471527391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4778be99-64ed-481f-abe7-d7fc09864241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af625098be4f259be24a358102226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:45Z,use_quota=True,user_id='640396ffb81141aa8dd4cf762c6e964e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:45 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-021e2585-d92c-4011-849e-b72d0068e515 Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6931d927-0172-47d4-9cfb-9bb4e04f18c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:45 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6931d927-0172-47d4-9cfb-9bb4e04f18c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d4289c-048a-4fec-9ea3-ae28534cbfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d4289c-048a-4fec-9ea3-ae28534cbfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4778be99-64ed-481f-abe7-d7fc09864241', 'volume_name': 'volume-4778be99-64ed-481f-abe7-d7fc09864241', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa21d849-fbfa-433c-8f83-7c6f0143d119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa21d849-fbfa-433c-8f83-7c6f0143d119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b02dde-9bdb-4b34-84d9-bc52890bd47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:45 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Volume 4778be99-64ed-481f-abe7-d7fc09864241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4778be99-64ed-481f-abe7-d7fc09864241', 'volume_size': 1} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Flow 'volume_create_manager' (1115a080-bc06-408b-b988-582477c88753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50fc1cbc-c7a4-4147-9d01-6a28517ca208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50fc1cbc-c7a4-4147-9d01-6a28517ca208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1216072451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=494794eb-2ee3-43fe-810a-f30912f050a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af625098be4f259be24a358102226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:46Z,use_quota=True,user_id='640396ffb81141aa8dd4cf762c6e964e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac05d65-014f-4365-a804-347a94a37661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac05d65-014f-4365-a804-347a94a37661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268f3762-6b65-4703-bf2a-79098ab0271c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268f3762-6b65-4703-bf2a-79098ab0271c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '494794eb-2ee3-43fe-810a-f30912f050a8', 'volume_name': 'volume-494794eb-2ee3-43fe-810a-f30912f050a8', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8d219f-19a6-47df-aee1-5f3ba63610eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8d219f-19a6-47df-aee1-5f3ba63610eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223d5025-6127-4038-97c0-bc90c5ebb288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:45 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Volume 494794eb-2ee3-43fe-810a-f30912f050a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-494794eb-2ee3-43fe-810a-f30912f050a8', 'volume_size': 1} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:45 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-021e2585-d92c-4011-849e-b72d0068e515" returned: 0 in 0.730s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:53:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.671s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1353576611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178cc536-6328-4d88-a4bc-aec3c26d3919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af625098be4f259be24a358102226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:44Z,use_quota=True,user_id='640396ffb81141aa8dd4cf762c6e964e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Creating volume 178cc536-6328-4d88-a4bc-aec3c26d3919 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:53:46 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-178cc536-6328-4d88-a4bc-aec3c26d3919 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:46 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-178cc536-6328-4d88-a4bc-aec3c26d3919 1073741824 Jun 02 00:53:46 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec80c6cb-6790-4212-a38e-65584eec52d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-021e2585-d92c-4011-849e-b72d0068e515', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d602d467-edc2-4f99-8166-9758588d7c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Flow 'volume_create_manager' (91230d24-c845-40b2-9db4-bf4a535966ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3114b69f-e2c7-4a16-8050-9557be96af7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3114b69f-e2c7-4a16-8050-9557be96af7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-864174040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8df3c2e-ee37-4fd7-860b-9504bf286817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af625098be4f259be24a358102226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:46Z,use_quota=True,user_id='640396ffb81141aa8dd4cf762c6e964e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7bb4d4-8648-4d0b-b002-aba1c2046dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7bb4d4-8648-4d0b-b002-aba1c2046dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f63b9ee-ef9f-41c9-860d-e3fd060124f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f63b9ee-ef9f-41c9-860d-e3fd060124f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8df3c2e-ee37-4fd7-860b-9504bf286817', 'volume_name': 'volume-b8df3c2e-ee37-4fd7-860b-9504bf286817', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ef897c-e501-4068-9d79-53aaf8c25e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ef897c-e501-4068-9d79-53aaf8c25e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1733b4bf-09f3-41ab-9d78-4f3e9944322a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:46 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Volume b8df3c2e-ee37-4fd7-860b-9504bf286817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8df3c2e-ee37-4fd7-860b-9504bf286817', 'volume_size': 1} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:46 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Volume volume-021e2585-d92c-4011-849e-b72d0068e515 (021e2585-d92c-4011-849e-b72d0068e515): created successfully Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d602d467-edc2-4f99-8166-9758588d7c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Flow 'volume_create_manager' (8bae1cd0-7afb-45f8-86bb-4d58467eb16d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:46 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-46f50102-2caf-4ed4-86d3-772c9495d5cf tempest-CinderUnicodeTest-803402313 None] Created volume successfully. Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Flow 'volume_create_manager' (c59a8381-a0e9-48fa-8f08-9f51622090be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1e1231-2948-4ff6-b1a1-36f9e26aaa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1e1231-2948-4ff6-b1a1-36f9e26aaa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1969497654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7226b5-c4f0-4174-81e1-ef1d308e224b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1b8be90ce0420e8d6cdf46c36f17f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:47Z,use_quota=True,user_id='6934f065197a478597880f0dbc913de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe0d4c8-6f16-45ac-b3ba-e2863fabf7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe0d4c8-6f16-45ac-b3ba-e2863fabf7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:46 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec1fadc-de02-4180-8786-dc1025e070fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec1fadc-de02-4180-8786-dc1025e070fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a7226b5-c4f0-4174-81e1-ef1d308e224b', 'volume_name': 'volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef42252e-d577-40f8-a149-f42ee4970ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef42252e-d577-40f8-a149-f42ee4970ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5b73e9-8153-4f66-992a-b4a59a4379df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:46 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Volume 5a7226b5-c4f0-4174-81e1-ef1d308e224b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b', 'volume_size': 1} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-178cc536-6328-4d88-a4bc-aec3c26d3919 1073741824" returned: 0 in 0.900s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-178cc536-6328-4d88-a4bc-aec3c26d3919 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:46 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-178cc536-6328-4d88-a4bc-aec3c26d3919 Jun 02 00:53:46 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:47 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-178cc536-6328-4d88-a4bc-aec3c26d3919" returned: 0 in 0.619s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.874s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1551893095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bff803e-0173-43bb-8730-13a7b4254f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af625098be4f259be24a358102226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:45Z,use_quota=True,user_id='640396ffb81141aa8dd4cf762c6e964e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Creating volume 3bff803e-0173-43bb-8730-13a7b4254f74 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:53:47 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3bff803e-0173-43bb-8730-13a7b4254f74 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:47 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3bff803e-0173-43bb-8730-13a7b4254f74 1073741824 Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b555c69-b3b2-4b4e-a3b2-5fa222f0a5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-178cc536-6328-4d88-a4bc-aec3c26d3919', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:47 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e8cb0f5-c0e3-474b-9691-198be7a5a146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:47 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Volume volume-178cc536-6328-4d88-a4bc-aec3c26d3919 (178cc536-6328-4d88-a4bc-aec3c26d3919): created successfully Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e8cb0f5-c0e3-474b-9691-198be7a5a146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Flow 'volume_create_manager' (5e00ed6f-4f5c-463e-8b23-22491ef0b423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:47 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ae50a5b7-9e28-41eb-bb75-1985f466c57f tempest-CreateVolumesFromImageTest-843077540 None] Created volume successfully. Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Flow 'volume_create_manager' (05f7abcb-efcb-4bf6-bbfe-67cd35c459ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ccebe3-37a4-4f33-b0f3-e38fb4bce2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ccebe3-37a4-4f33-b0f3-e38fb4bce2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0c6f91-a426-4636-b078-5f892cc3a7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aad022f1f84455d89780a164bb5b639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:48Z,use_quota=True,user_id='cae856c97c304d7d902272277517b1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bff8f202-a1c8-4408-b898-34e4b711d460),volume_type_id=bff8f202-a1c8-4408-b898-34e4b711d460)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa08985-295c-4344-a058-98f6bb24d1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa08985-295c-4344-a058-98f6bb24d1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99825c40-5656-45d2-97db-6cb0e9e10c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:47 devstack cinder-volume[86910]: DEBUG cinder.image.glance [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Creating Keystone auth plugin from conf {{(pid=86910) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 00:53:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99825c40-5656-45d2-97db-6cb0e9e10c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b0c6f91-a426-4636-b078-5f892cc3a7f5', 'volume_name': 'volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5', 'volume_size': 1, 'image_id': '0ec8a6e4-a488-4348-abbc-1d36a48735fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ec8a6e4-a488-4348-abbc-1d36a48735fa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd5219bc4dd59429d3327711b0fb18863', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5aad022f1f84455d89780a164bb5b639', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca17a8db5a166c6d2beb77fb3af1f5b44772b71d1fc34c7eaf472252bb16bcade7f7973b0835324351a47749054eaabcb552f1ffcf54085bf1a862d2bf42e779', 'id': '0ec8a6e4-a488-4348-abbc-1d36a48735fa', 'created_at': datetime.datetime(2026, 6, 1, 22, 53, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 53, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ec8a6e4-a488-4348-abbc-1d36a48735fa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d68722a-27cc-419c-9a92-c87e981ffe98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d68722a-27cc-419c-9a92-c87e981ffe98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24146142-d6ff-4100-b12d-1139fc610505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:48 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Volume 7b0c6f91-a426-4636-b078-5f892cc3a7f5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5', 'volume_size': 1, 'image_id': '0ec8a6e4-a488-4348-abbc-1d36a48735fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ec8a6e4-a488-4348-abbc-1d36a48735fa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd5219bc4dd59429d3327711b0fb18863', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5aad022f1f84455d89780a164bb5b639', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca17a8db5a166c6d2beb77fb3af1f5b44772b71d1fc34c7eaf472252bb16bcade7f7973b0835324351a47749054eaabcb552f1ffcf54085bf1a862d2bf42e779', 'id': '0ec8a6e4-a488-4348-abbc-1d36a48735fa', 'created_at': datetime.datetime(2026, 6, 1, 22, 53, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 53, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ec8a6e4-a488-4348-abbc-1d36a48735fa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 02 00:53:48 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Trying to clone 7b0c6f91-a426-4636-b078-5f892cc3a7f5 from image 0ec8a6e4-a488-4348-abbc-1d36a48735fa at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ec8a6e4-a488-4348-abbc-1d36a48735fa', 'metadata': {}}]). {{(pid=86910) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 00:53:48 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3bff803e-0173-43bb-8730-13a7b4254f74 1073741824" returned: 0 in 0.811s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3bff803e-0173-43bb-8730-13a7b4254f74 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:48 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 00:53:48 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Image download 0.00 MB at 0.00 MB/s Jun 02 00:53:48 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3bff803e-0173-43bb-8730-13a7b4254f74 Jun 02 00:53:48 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:48 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3da8fbe-ef14-45b3-bd6c-0c29b83020c9]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:53:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:48 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD Jun 02 00:53:48 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:49 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3bff803e-0173-43bb-8730-13a7b4254f74" returned: 0 in 0.665s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.127s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-81481313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b69d25-aec4-452d-81fc-59ee395693f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dca3deb9ce64f629c2e359723d49f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:45Z,use_quota=True,user_id='5cb38450cb4d4a6391a3ad213150cf8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Creating volume a8b69d25-aec4-452d-81fc-59ee395693f3 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:53:49 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e0b857-cdc6-422d-9707-d3e174d01cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bff803e-0173-43bb-8730-13a7b4254f74', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:49 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3 1073741824 Jun 02 00:53:49 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdee260e-b0b7-4cea-aa85-b38d4a0c3590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:49 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Volume volume-3bff803e-0173-43bb-8730-13a7b4254f74 (3bff803e-0173-43bb-8730-13a7b4254f74): created successfully Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdee260e-b0b7-4cea-aa85-b38d4a0c3590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Flow 'volume_create_manager' (263e7739-b9ea-4651-8ac2-d21e89a26090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:49 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:49 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-25b5357a-6d91-4bfe-864c-89b7d9a9f16a tempest-CreateVolumesFromImageTest-843077540 None] Created volume successfully. Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD" returned: 0 in 0.718s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:49 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD Jun 02 00:53:49 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:49 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD" returned: 1 in 0.699s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Temporary image 0ec8a6e4-a488-4348-abbc-1d36a48735fa is fetched for user cae856c97c304d7d902272277517b1b1. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 00:53:49 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3 1073741824" returned: 0 in 0.801s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:49 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3 Jun 02 00:53:49 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dcb080-0103-4a75-9e41-580f02c6f8db]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:53:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:50 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD Jun 02 00:53:50 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:50 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3" returned: 0 in 0.620s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.255s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-471527391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4778be99-64ed-481f-abe7-d7fc09864241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af625098be4f259be24a358102226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:45Z,use_quota=True,user_id='640396ffb81141aa8dd4cf762c6e964e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Creating volume 4778be99-64ed-481f-abe7-d7fc09864241 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:53:50 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4778be99-64ed-481f-abe7-d7fc09864241 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c8ec8e-613a-441e-a4eb-0cee52cff3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b69d25-aec4-452d-81fc-59ee395693f3', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:50 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4778be99-64ed-481f-abe7-d7fc09864241 1073741824 Jun 02 00:53:50 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745203cb-8989-418b-986a-23e93f3691f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:50 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume volume-a8b69d25-aec4-452d-81fc-59ee395693f3 (a8b69d25-aec4-452d-81fc-59ee395693f3): created successfully Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745203cb-8989-418b-986a-23e93f3691f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:50 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Flow 'volume_create_manager' (4e38b60a-4b2a-401e-859c-f8bef2f95c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD" returned: 0 in 0.666s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:50 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-8186454d-6c49-495e-8989-f2dad708b554 tempest-CreateVolumesFromSnapshotTest-22309991 None] Created volume successfully. Jun 02 00:53:50 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD Jun 02 00:53:50 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:51 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD" returned: 1 in 0.693s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:53:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:51 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4778be99-64ed-481f-abe7-d7fc09864241 1073741824" returned: 0 in 0.859s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4778be99-64ed-481f-abe7-d7fc09864241 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:51 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4778be99-64ed-481f-abe7-d7fc09864241 Jun 02 00:53:51 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:52 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4778be99-64ed-481f-abe7-d7fc09864241" returned: 0 in 0.608s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.359s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1216072451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=494794eb-2ee3-43fe-810a-f30912f050a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af625098be4f259be24a358102226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:46Z,use_quota=True,user_id='640396ffb81141aa8dd4cf762c6e964e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Creating volume 494794eb-2ee3-43fe-810a-f30912f050a8 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:53:52 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-494794eb-2ee3-43fe-810a-f30912f050a8 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:52 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-494794eb-2ee3-43fe-810a-f30912f050a8 1073741824 Jun 02 00:53:52 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b02dde-9bdb-4b34-84d9-bc52890bd47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4778be99-64ed-481f-abe7-d7fc09864241', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e53fb80-28fd-4491-8366-7479306659d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:52 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Volume volume-4778be99-64ed-481f-abe7-d7fc09864241 (4778be99-64ed-481f-abe7-d7fc09864241): created successfully Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e53fb80-28fd-4491-8366-7479306659d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Flow 'volume_create_manager' (fa8473a2-f752-4845-b4b8-18ce99ea2a66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:52 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-8b8bfa2d-59b5-45b6-901e-d17cbf36c284 tempest-CreateVolumesFromImageTest-843077540 None] Created volume successfully. Jun 02 00:53:52 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-494794eb-2ee3-43fe-810a-f30912f050a8 1073741824" returned: 0 in 0.770s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-494794eb-2ee3-43fe-810a-f30912f050a8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:52 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-494794eb-2ee3-43fe-810a-f30912f050a8 Jun 02 00:53:52 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:53 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-494794eb-2ee3-43fe-810a-f30912f050a8" returned: 0 in 0.574s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:53 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:53:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.356s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:53 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-864174040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8df3c2e-ee37-4fd7-860b-9504bf286817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af625098be4f259be24a358102226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:46Z,use_quota=True,user_id='640396ffb81141aa8dd4cf762c6e964e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:53:53 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Creating volume b8df3c2e-ee37-4fd7-860b-9504bf286817 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:53:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:53 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:53 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:53 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:53:53 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:53:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b8df3c2e-ee37-4fd7-860b-9504bf286817 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:53 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b8df3c2e-ee37-4fd7-860b-9504bf286817 1073741824 Jun 02 00:53:53 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:53 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223d5025-6127-4038-97c0-bc90c5ebb288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-494794eb-2ee3-43fe-810a-f30912f050a8', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:53 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80248c2d-ca22-4ea9-add1-da6b1825cf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:53 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Volume volume-494794eb-2ee3-43fe-810a-f30912f050a8 (494794eb-2ee3-43fe-810a-f30912f050a8): created successfully Jun 02 00:53:53 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80248c2d-ca22-4ea9-add1-da6b1825cf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:53 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Flow 'volume_create_manager' (1115a080-bc06-408b-b988-582477c88753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:53 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ec560157-5547-4961-bfe3-cd54f449751e tempest-CreateVolumesFromImageTest-843077540 None] Created volume successfully. Jun 02 00:53:54 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b8df3c2e-ee37-4fd7-860b-9504bf286817 1073741824" returned: 0 in 0.766s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b8df3c2e-ee37-4fd7-860b-9504bf286817 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:54 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b8df3c2e-ee37-4fd7-860b-9504bf286817 Jun 02 00:53:54 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:54 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b8df3c2e-ee37-4fd7-860b-9504bf286817" returned: 0 in 0.588s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.983s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1969497654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7226b5-c4f0-4174-81e1-ef1d308e224b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1b8be90ce0420e8d6cdf46c36f17f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:47Z,use_quota=True,user_id='6934f065197a478597880f0dbc913de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Creating volume 5a7226b5-c4f0-4174-81e1-ef1d308e224b {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:53:54 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:54 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b 1073741824 Jun 02 00:53:54 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1733b4bf-09f3-41ab-9d78-4f3e9944322a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8df3c2e-ee37-4fd7-860b-9504bf286817', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ef569e-5a43-417e-a8ce-7fc9b869fad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:54 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Volume volume-b8df3c2e-ee37-4fd7-860b-9504bf286817 (b8df3c2e-ee37-4fd7-860b-9504bf286817): created successfully Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ef569e-5a43-417e-a8ce-7fc9b869fad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Flow 'volume_create_manager' (91230d24-c845-40b2-9db4-bf4a535966ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:54 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-c2196520-e816-4d67-82ed-a094ec420e00 tempest-CreateVolumesFromImageTest-843077540 None] Created volume successfully. Jun 02 00:53:55 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b 1073741824" returned: 0 in 0.750s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:55 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b Jun 02 00:53:55 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:55 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "cinder-b8df3c2e-ee37-4fd7-860b-9504bf286817-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:55 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-b8df3c2e-ee37-4fd7-860b-9504bf286817-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:55 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "cinder-quobyte-b8df3c2e-ee37-4fd7-860b-9504bf286817" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:55 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-quobyte-b8df3c2e-ee37-4fd7-860b-9504bf286817" acquired by "delete_volume" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:55 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66bc598-04bf-40e2-b818-48cd1c9348b0]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:53:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b8df3c2e-ee37-4fd7-860b-9504bf286817 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:56 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b8df3c2e-ee37-4fd7-860b-9504bf286817 Jun 02 00:53:56 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:56 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b" returned: 0 in 0.601s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.935s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0c6f91-a426-4636-b078-5f892cc3a7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aad022f1f84455d89780a164bb5b639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:53:48Z,use_quota=True,user_id='cae856c97c304d7d902272277517b1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bff8f202-a1c8-4408-b898-34e4b711d460),volume_type_id=bff8f202-a1c8-4408-b898-34e4b711d460)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Creating volume 7b0c6f91-a426-4636-b078-5f892cc3a7f5 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:53:56 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5b73e9-8153-4f66-992a-b4a59a4379df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:56 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 1073741824 Jun 02 00:53:56 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969b5204-b4b1-49fa-a712-acfc842d5ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:53:56 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Volume volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b (5a7226b5-c4f0-4174-81e1-ef1d308e224b): created successfully Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969b5204-b4b1-49fa-a712-acfc842d5ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Flow 'volume_create_manager' (c59a8381-a0e9-48fa-8f08-9f51622090be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:53:56 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-4847cfc6-58b3-42af-90ef-8e523266c622 tempest-CinderUnicodeTest-803402313 None] Created volume successfully. Jun 02 00:53:56 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b8df3c2e-ee37-4fd7-860b-9504bf286817" returned: 0 in 0.721s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b8df3c2e-ee37-4fd7-860b-9504bf286817 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:56 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b8df3c2e-ee37-4fd7-860b-9504bf286817 Jun 02 00:53:56 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:57 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 1073741824" returned: 0 in 0.763s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:57 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 Jun 02 00:53:57 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:57 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-b8df3c2e-ee37-4fd7-860b-9504bf286817" returned: 0 in 0.621s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-quobyte-b8df3c2e-ee37-4fd7-860b-9504bf286817" released by "delete_volume" :: held 1.389s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] Created reservations ['c3c9d29b-7a27-4625-a6a0-b9bc1d5a1c66', '50c44bee-251c-4614-899f-c425c73b5aed', '44e7359e-6518-42ff-9d58-75d73966be09', '20534627-7e96-4fe1-93db-c09a05ad34f7'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:57 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:53:57 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:57 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5" returned: 0 in 0.647s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.276s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] Creating offline snapshot 35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32 of volume a8b69d25-aec4-452d-81fc-59ee395693f3 {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Attempting download of 0ec8a6e4-a488-4348-abbc-1d36a48735fa ((None, [{'url': 'file:///opt/stack/data/glance/images/0ec8a6e4-a488-4348-abbc-1d36a48735fa', 'metadata': {}}])) to volume 7b0c6f91-a426-4636-b078-5f892cc3a7f5. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[79659f2e-2c79-4075-88b7-d0a1647d2418]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bad8ae-bda5-473f-ab85-8a5c1869656e]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:53:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ec8a6e4-a488-4348-abbc-1d36a48735fa_fwnhawev {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:57 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3 Jun 02 00:53:57 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:57 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ec8a6e4-a488-4348-abbc-1d36a48735fa_fwnhawev Jun 02 00:53:57 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:58 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.627s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:58 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:53:58 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] Deleted volume successfully. Jun 02 00:53:58 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-02248bab-af8e-4d4e-9301-dcdf33955e74 tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-b8df3c2e-ee37-4fd7-860b-9504bf286817-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:58 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "cinder-494794eb-2ee3-43fe-810a-f30912f050a8-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:58 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-494794eb-2ee3-43fe-810a-f30912f050a8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:58 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "cinder-quobyte-494794eb-2ee3-43fe-810a-f30912f050a8" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:53:58 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-quobyte-494794eb-2ee3-43fe-810a-f30912f050a8" acquired by "delete_volume" :: waited 0.030s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:53:58 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be1e0f5-c416-4a13-9ea7-a7e17c605266]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:53:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-494794eb-2ee3-43fe-810a-f30912f050a8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:58 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-494794eb-2ee3-43fe-810a-f30912f050a8 Jun 02 00:53:58 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:58 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ec8a6e4-a488-4348-abbc-1d36a48735fa_fwnhawev" returned: 0 in 0.725s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ec8a6e4-a488-4348-abbc-1d36a48735fa_fwnhawev {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:58 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3" returned: 0 in 0.817s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:58 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32 1G Jun 02 00:53:58 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:58 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ec8a6e4-a488-4348-abbc-1d36a48735fa_fwnhawev Jun 02 00:53:58 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:58 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-494794eb-2ee3-43fe-810a-f30912f050a8" returned: 0 in 0.723s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-494794eb-2ee3-43fe-810a-f30912f050a8 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:58 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-494794eb-2ee3-43fe-810a-f30912f050a8 Jun 02 00:53:58 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:59 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ec8a6e4-a488-4348-abbc-1d36a48735fa_fwnhawev" returned: 1 in 0.701s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ec8a6e4-a488-4348-abbc-1d36a48735fa_fwnhawev' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:53:59 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9a1f84-ca0d-4603-a1c9-d02eb29133b6]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:53:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:59 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD Jun 02 00:53:59 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:59 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32 1G" returned: 0 in 0.795s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b69d25-aec4-452d-81fc-59ee395693f3 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:59 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b69d25-aec4-452d-81fc-59ee395693f3 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32 Jun 02 00:53:59 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:59 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-494794eb-2ee3-43fe-810a-f30912f050a8" returned: 0 in 0.599s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:59 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-quobyte-494794eb-2ee3-43fe-810a-f30912f050a8" released by "delete_volume" :: held 1.377s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:53:59 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] Created reservations ['16033e19-40e3-4b34-9f2c-97e1cb2e812b', 'a0619cd2-30c4-483c-8b70-092c3f55c951', '68c8d3d8-4740-4912-9f2f-56ce4537ecb9', '4a3c7413-c928-4d01-b4f0-1f6d598f25bc'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:53:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:53:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:53:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:53:59 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:53:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:53:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:53:59 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:53:59 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:53:59 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jun 02 00:53:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD" returned: 0 in 0.708s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:53:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:00 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD Jun 02 00:54:00 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:00 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b69d25-aec4-452d-81fc-59ee395693f3 -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32" returned: 0 in 0.706s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:00 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32 is being set with open permissions: ugo+rw Jun 02 00:54:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:00 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32 Jun 02 00:54:00 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:00 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.647s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:00 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:00 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] Deleted volume successfully. Jun 02 00:54:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "cinder-4778be99-64ed-481f-abe7-d7fc09864241-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-4778be99-64ed-481f-abe7-d7fc09864241-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-87930636-93d5-4d57-af49-dc66ed09f544 tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-494794eb-2ee3-43fe-810a-f30912f050a8-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "cinder-quobyte-4778be99-64ed-481f-abe7-d7fc09864241" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-quobyte-4778be99-64ed-481f-abe7-d7fc09864241" acquired by "delete_volume" :: waited 0.016s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:00 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b262a92-3f76-4a51-aec3-9e3e66ce5420]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4778be99-64ed-481f-abe7-d7fc09864241 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:00 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4778be99-64ed-481f-abe7-d7fc09864241 Jun 02 00:54:00 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:00 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD" returned: 1 in 0.745s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:54:00 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] 0ec8a6e4-a488-4348-abbc-1d36a48735fa was raw, converting to raw {{(pid=86910) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 00:54:00 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32" returned: 0 in 0.632s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:00 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 Jun 02 00:54:00 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:00 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.info Jun 02 00:54:00 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:01 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4778be99-64ed-481f-abe7-d7fc09864241" returned: 0 in 0.722s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4778be99-64ed-481f-abe7-d7fc09864241 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:01 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4778be99-64ed-481f-abe7-d7fc09864241 Jun 02 00:54:01 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:01 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.info" returned: 0 in 0.613s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:01 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.info is being set with open permissions: ugo+rw Jun 02 00:54:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:01 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5" returned: 0 in 0.698s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:01 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.info Jun 02 00:54:01 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ec8a6e4-a488-4348-abbc-1d36a48735fa_db447_a3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:54:01 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Converted 0.00 MB image at 0.00 MB/s Jun 02 00:54:01 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:01 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 1G Jun 02 00:54:01 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:01 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-4778be99-64ed-481f-abe7-d7fc09864241" returned: 0 in 0.624s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-quobyte-4778be99-64ed-481f-abe7-d7fc09864241" released by "delete_volume" :: held 1.394s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:01 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] Created reservations ['a0fa3529-dd3e-4973-9907-468cbad9d27e', '058fdf38-516b-4f2d-bf48-0a72beeb703c', '45a5df6b-2e15-499b-835e-58b6e3ab061b', 'da0c79d1-db78-4608-bd48-7b16f878d0b8'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:01 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:01 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:02 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.info" returned: 0 in 0.608s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.279s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.328s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] Creating offline snapshot 29aa995f-22a0-48a6-a745-b51439afd182 of volume 5a7226b5-c4f0-4174-81e1-ef1d308e224b {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:54:02 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-aeb06244-0172-4e4d-9539-ef126d34b631 tempest-CreateVolumesFromSnapshotTest-22309991 None] Create snapshot completed successfully Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd16beb-1b92-42e1-8f0b-ea2a97e54e8d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:02 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 1G" returned: 0 in 0.742s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:02 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b Jun 02 00:54:02 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[38982aba-dbec-4ba0-8448-4d626754794f]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:02 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 Jun 02 00:54:02 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:02 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "cinder-3bff803e-0173-43bb-8730-13a7b4254f74-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.647s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:02 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] Deleted volume successfully. Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-3bff803e-0173-43bb-8730-13a7b4254f74-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-64b8c043-1dc1-4110-936f-5c1bbf21e78d tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-4778be99-64ed-481f-abe7-d7fc09864241-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "cinder-quobyte-3bff803e-0173-43bb-8730-13a7b4254f74" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-quobyte-3bff803e-0173-43bb-8730-13a7b4254f74" acquired by "delete_volume" :: waited 0.023s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5abcd4-b766-4d19-93ab-c0718675e030]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3bff803e-0173-43bb-8730-13a7b4254f74 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:02 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3bff803e-0173-43bb-8730-13a7b4254f74 Jun 02 00:54:02 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:02 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b" returned: 0 in 0.840s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:02 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182 1G Jun 02 00:54:02 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:03 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5" returned: 0 in 0.783s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:03 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 Jun 02 00:54:03 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Flow 'volume_create_manager' (07735f65-a5bc-404f-b101-bcbc9082e957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ad868d-9e48-4e82-857b-9439bd36fed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ad868d-9e48-4e82-857b-9439bd36fed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1740251951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3100d694-97d1-4cd1-a004-5dfc74e74f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dca3deb9ce64f629c2e359723d49f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:03Z,use_quota=True,user_id='5cb38450cb4d4a6391a3ad213150cf8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d00c1a8-f15f-4763-82b1-26b29f9318a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d00c1a8-f15f-4763-82b1-26b29f9318a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da8610e-1b9b-46fb-86b4-dda9a2577895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da8610e-1b9b-46fb-86b4-dda9a2577895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3100d694-97d1-4cd1-a004-5dfc74e74f50', 'volume_name': 'volume-3100d694-97d1-4cd1-a004-5dfc74e74f50', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24516157-6a83-423f-bd8c-76c57dab636c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24516157-6a83-423f-bd8c-76c57dab636c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99484892-022d-48f3-86be-c3c799e0debe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:03 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume 3100d694-97d1-4cd1-a004-5dfc74e74f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3100d694-97d1-4cd1-a004-5dfc74e74f50', 'volume_size': 1} Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:03 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3bff803e-0173-43bb-8730-13a7b4254f74" returned: 0 in 0.922s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3bff803e-0173-43bb-8730-13a7b4254f74 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:03 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3bff803e-0173-43bb-8730-13a7b4254f74 Jun 02 00:54:03 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:54:03 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Flow 'volume_create_manager' (a3b0121f-f5c0-43ea-b0e8-dada028f8019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbd76db-bdb7-4032-b9dd-563833ef3386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbd76db-bdb7-4032-b9dd-563833ef3386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1360613778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570a3eb6-b11f-4191-ab64-516fb15f2938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dca3deb9ce64f629c2e359723d49f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:04Z,use_quota=True,user_id='5cb38450cb4d4a6391a3ad213150cf8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e5c05f-332d-4d9e-8d01-c557d9bc1e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e5c05f-332d-4d9e-8d01-c557d9bc1e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efcbf985-41ac-4c84-8321-61a0addbaac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efcbf985-41ac-4c84-8321-61a0addbaac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '570a3eb6-b11f-4191-ab64-516fb15f2938', 'volume_name': 'volume-570a3eb6-b11f-4191-ab64-516fb15f2938', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369ca2b7-4cff-4bf4-a94e-92dc4a8775d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:04 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369ca2b7-4cff-4bf4-a94e-92dc4a8775d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b43f9e4-2406-469c-8091-a41873803047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:04 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume 570a3eb6-b11f-4191-ab64-516fb15f2938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-570a3eb6-b11f-4191-ab64-516fb15f2938', 'volume_size': 1} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5" returned: 1 in 1.083s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Downloaded image 0ec8a6e4-a488-4348-abbc-1d36a48735fa ((None, [{'url': 'file:///opt/stack/data/glance/images/0ec8a6e4-a488-4348-abbc-1d36a48735fa', 'metadata': {}}])) to volume 7b0c6f91-a426-4636-b078-5f892cc3a7f5 successfully. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Temporary image 0ec8a6e4-a488-4348-abbc-1d36a48735fa for user cae856c97c304d7d902272277517b1b1 is deleted. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Marking volume 7b0c6f91-a426-4636-b078-5f892cc3a7f5 as bootable. {{(pid=86910) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Copying metadata from image 0ec8a6e4-a488-4348-abbc-1d36a48735fa to 7b0c6f91-a426-4636-b078-5f892cc3a7f5. {{(pid=86910) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Creating volume glance metadata for volume 7b0c6f91-a426-4636-b078-5f892cc3a7f5 backed by image 0ec8a6e4-a488-4348-abbc-1d36a48735fa with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0ec8a6e4-a488-4348-abbc-1d36a48735fa', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd5219bc4dd59429d3327711b0fb18863', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86910) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 00:54:04 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182 1G" returned: 0 in 1.196s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:04 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182 Jun 02 00:54:04 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24146142-d6ff-4100-b12d-1139fc610505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5', 'volume_size': 1, 'image_id': '0ec8a6e4-a488-4348-abbc-1d36a48735fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ec8a6e4-a488-4348-abbc-1d36a48735fa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd5219bc4dd59429d3327711b0fb18863', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5aad022f1f84455d89780a164bb5b639', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca17a8db5a166c6d2beb77fb3af1f5b44772b71d1fc34c7eaf472252bb16bcade7f7973b0835324351a47749054eaabcb552f1ffcf54085bf1a862d2bf42e779', 'id': '0ec8a6e4-a488-4348-abbc-1d36a48735fa', 'created_at': datetime.datetime(2026, 6, 1, 22, 53, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 53, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ec8a6e4-a488-4348-abbc-1d36a48735fa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3096a5-4539-4508-afea-1cd3f44f2e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:04 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Volume volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 (7b0c6f91-a426-4636-b078-5f892cc3a7f5): created successfully Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3096a5-4539-4508-afea-1cd3f44f2e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Flow 'volume_create_manager' (05f7abcb-efcb-4bf6-bbfe-67cd35c459ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:04 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a78f7892-3ac1-4873-8ba5-92948373a2a6 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Created volume successfully. Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Flow 'volume_create_manager' (63319d60-0519-4c0e-bc3c-c3b55b7e9b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63769fb6-f04d-49c0-b425-0aa1f2a7d300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63769fb6-f04d-49c0-b425-0aa1f2a7d300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-947631592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5ea4c1-c7a0-4e56-99e0-19917c71355f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dca3deb9ce64f629c2e359723d49f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:04Z,use_quota=True,user_id='5cb38450cb4d4a6391a3ad213150cf8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0412bf-b6d5-45be-89b6-0c4487ec6b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0412bf-b6d5-45be-89b6-0c4487ec6b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe8714b-880d-448b-b678-39be2669fb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe8714b-880d-448b-b678-39be2669fb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce5ea4c1-c7a0-4e56-99e0-19917c71355f', 'volume_name': 'volume-ce5ea4c1-c7a0-4e56-99e0-19917c71355f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936f736b-90a9-4851-8b00-e9204ff98c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936f736b-90a9-4851-8b00-e9204ff98c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462109e2-8984-4e93-8c20-e3b08731cb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:04 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume ce5ea4c1-c7a0-4e56-99e0-19917c71355f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce5ea4c1-c7a0-4e56-99e0-19917c71355f', 'volume_size': 1} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:04 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3bff803e-0173-43bb-8730-13a7b4254f74" returned: 0 in 0.868s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-quobyte-3bff803e-0173-43bb-8730-13a7b4254f74" released by "delete_volume" :: held 1.837s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] Created reservations ['a59185a0-c5e1-4a3a-87b7-77c14fcc3839', 'bc42592c-20a1-4a75-abf0-83413127feea', 'ae5ea127-06d9-4990-bc1d-dedc1d5c2f86', '8745dbf8-1470-4cb4-87c2-d7ce9f7b5cc7'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:04 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:04 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Flow 'volume_create_manager' (a13aa914-3e2f-4e54-97f5-0070ab335095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b77deb-ca31-41dd-a6e8-be36f78eec1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b77deb-ca31-41dd-a6e8-be36f78eec1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-936807614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d299cd5d-21ec-4e7d-9556-beb65bd8519a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dca3deb9ce64f629c2e359723d49f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:05Z,use_quota=True,user_id='5cb38450cb4d4a6391a3ad213150cf8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104b76a2-19bb-42d0-994e-9cc9fd37deec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104b76a2-19bb-42d0-994e-9cc9fd37deec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2951a584-6f8d-4ad8-bfdd-be180401f933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2951a584-6f8d-4ad8-bfdd-be180401f933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd299cd5d-21ec-4e7d-9556-beb65bd8519a', 'volume_name': 'volume-d299cd5d-21ec-4e7d-9556-beb65bd8519a', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90a0372-6d7b-4ac6-9007-3eea6e68a266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90a0372-6d7b-4ac6-9007-3eea6e68a266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e8e7714-3dce-41c8-8a02-a1d983328057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:04 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume d299cd5d-21ec-4e7d-9556-beb65bd8519a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d299cd5d-21ec-4e7d-9556-beb65bd8519a', 'volume_size': 1} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "cinder-178cc536-6328-4d88-a4bc-aec3c26d3919-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:04 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182" returned: 0 in 0.849s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:04 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182 is being set with open permissions: ugo+rw Jun 02 00:54:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-178cc536-6328-4d88-a4bc-aec3c26d3919-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:05 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182 Jun 02 00:54:05 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "cinder-quobyte-178cc536-6328-4d88-a4bc-aec3c26d3919" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-quobyte-178cc536-6328-4d88-a4bc-aec3c26d3919" acquired by "delete_volume" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Acquiring lock "cinder-7b0c6f91-a426-4636-b078-5f892cc3a7f5-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6760a8a7-cc51-4c87-85ea-d929fba32a4f]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-178cc536-6328-4d88-a4bc-aec3c26d3919 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Lock "cinder-7b0c6f91-a426-4636-b078-5f892cc3a7f5-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Flow 'volume_create_manager' (f2f0be10-4772-4452-9570-3c3f3bd02486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcecc653-380d-480a-9b6a-afbaaaefe672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcecc653-380d-480a-9b6a-afbaaaefe672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1644809322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bde5a84-913d-485d-88d7-801617d9cd4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dca3deb9ce64f629c2e359723d49f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:05Z,use_quota=True,user_id='5cb38450cb4d4a6391a3ad213150cf8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb1de32-6e18-4e07-87eb-faf35ac86cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb1de32-6e18-4e07-87eb-faf35ac86cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58900e7-20a4-45da-b4bd-758792246500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58900e7-20a4-45da-b4bd-758792246500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bde5a84-913d-485d-88d7-801617d9cd4c', 'volume_name': 'volume-2bde5a84-913d-485d-88d7-801617d9cd4c', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a60788c-e8a3-4e39-9ed7-90e007a4cb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a60788c-e8a3-4e39-9ed7-90e007a4cb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff92dda9-7747-4c78-8808-08b98e55677e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:05 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume 2bde5a84-913d-485d-88d7-801617d9cd4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bde5a84-913d-485d-88d7-801617d9cd4c', 'volume_size': 1} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Acquiring lock "cinder-quobyte-7b0c6f91-a426-4636-b078-5f892cc3a7f5" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:05 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-178cc536-6328-4d88-a4bc-aec3c26d3919 Jun 02 00:54:05 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Lock "cinder-quobyte-7b0c6f91-a426-4636-b078-5f892cc3a7f5" acquired by "delete_volume" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abae3cb-be96-42c4-a90d-e0064fb33af7]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:05 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.812s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:05 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] Deleted volume successfully. Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6c8fd5f7-5f3c-4ea3-92a3-a8ab10923558 tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-3bff803e-0173-43bb-8730-13a7b4254f74-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:05 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 Jun 02 00:54:05 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:05 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182" returned: 0 in 0.779s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:05 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:05 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.info Jun 02 00:54:05 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:06 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-178cc536-6328-4d88-a4bc-aec3c26d3919" returned: 0 in 0.823s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-178cc536-6328-4d88-a4bc-aec3c26d3919 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:06 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-178cc536-6328-4d88-a4bc-aec3c26d3919 Jun 02 00:54:06 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:06 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5" returned: 0 in 0.719s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:06 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 Jun 02 00:54:06 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:06 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.info" returned: 0 in 0.633s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:06 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.info is being set with open permissions: ugo+rw Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:06 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.info Jun 02 00:54:06 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:06 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-178cc536-6328-4d88-a4bc-aec3c26d3919" returned: 0 in 0.648s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-quobyte-178cc536-6328-4d88-a4bc-aec3c26d3919" released by "delete_volume" :: held 1.545s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] Created reservations ['9ff29cc5-7978-4783-9775-7e8b56cbeaf3', '3d75b248-171c-4d5e-95f0-25e6c1319e33', 'cb8f28f4-b159-4542-b64b-d71754f6c4da', '01f53139-682a-430c-841a-31f0360ca0b5'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:06 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:06 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:06 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5" returned: 1 in 0.754s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:54:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:06 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5 Jun 02 00:54:06 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:07 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.info" returned: 0 in 0.604s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.014s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.552s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1740251951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3100d694-97d1-4cd1-a004-5dfc74e74f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dca3deb9ce64f629c2e359723d49f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:03Z,use_quota=True,user_id='5cb38450cb4d4a6391a3ad213150cf8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Creating volume 3100d694-97d1-4cd1-a004-5dfc74e74f50 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:54:07 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3100d694-97d1-4cd1-a004-5dfc74e74f50 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:07 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3100d694-97d1-4cd1-a004-5dfc74e74f50 1073741824 Jun 02 00:54:07 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:07 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-35c8ca05-d77b-43b7-8427-6809b112c215 tempest-CinderUnicodeTest-803402313 None] Create snapshot completed successfully Jun 02 00:54:07 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.632s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:07 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] Deleted volume successfully. Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-5a48776c-053e-4bd4-801e-ef019d32b4f8 tempest-CreateVolumesFromImageTest-843077540 None] Lock "cinder-178cc536-6328-4d88-a4bc-aec3c26d3919-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:07 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7b0c6f91-a426-4636-b078-5f892cc3a7f5" returned: 0 in 0.761s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Lock "cinder-quobyte-7b0c6f91-a426-4636-b078-5f892cc3a7f5" released by "delete_volume" :: held 2.310s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Created reservations ['d93dbd54-d200-4c17-9599-4ad631cf1d39', '710a962c-648f-477d-a5d5-c5e9ddfb4f6e', 'cc21a5e4-00dd-4276-9b09-31cf73b8e4f2', '71092f91-0f75-445c-92c3-1a5e17273cec'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:07 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:07 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:07 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3100d694-97d1-4cd1-a004-5dfc74e74f50 1073741824" returned: 0 in 0.877s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3100d694-97d1-4cd1-a004-5dfc74e74f50 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:08 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3100d694-97d1-4cd1-a004-5dfc74e74f50 Jun 02 00:54:08 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] Acquiring lock "cinder-29aa995f-22a0-48a6-a745-b51439afd182-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] Lock "cinder-29aa995f-22a0-48a6-a745-b51439afd182-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] Acquiring lock "cinder-quobyte-5a7226b5-c4f0-4174-81e1-ef1d308e224b" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] Lock "cinder-quobyte-5a7226b5-c4f0-4174-81e1-ef1d308e224b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] Acquiring lock "cinder-quobyte-29aa995f-22a0-48a6-a745-b51439afd182" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] Lock "cinder-quobyte-29aa995f-22a0-48a6-a745-b51439afd182" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] Deleting offline snapshot 29aa995f-22a0-48a6-a745-b51439afd182 of volume 5a7226b5-c4f0-4174-81e1-ef1d308e224b {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] snapshot_file for this snap is: volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1107ab56-eefd-419a-a9fb-bfeac23cf189]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:08 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.722s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:08 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Deleted volume successfully. Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-027d46a4-95df-4a01-9452-439fce49e349 tempest-VolumeAndVolumeTypeFromImageTest-290929200 None] Lock "cinder-7b0c6f91-a426-4636-b078-5f892cc3a7f5-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:08 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182 Jun 02 00:54:08 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:08 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3100d694-97d1-4cd1-a004-5dfc74e74f50" returned: 0 in 0.816s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.723s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1360613778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570a3eb6-b11f-4191-ab64-516fb15f2938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dca3deb9ce64f629c2e359723d49f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:04Z,use_quota=True,user_id='5cb38450cb4d4a6391a3ad213150cf8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Creating volume 570a3eb6-b11f-4191-ab64-516fb15f2938 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:54:08 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-570a3eb6-b11f-4191-ab64-516fb15f2938 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99484892-022d-48f3-86be-c3c799e0debe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3100d694-97d1-4cd1-a004-5dfc74e74f50', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d36710-32af-427a-be7c-ccbda93fc923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:08 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-570a3eb6-b11f-4191-ab64-516fb15f2938 1073741824 Jun 02 00:54:08 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:08 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume volume-3100d694-97d1-4cd1-a004-5dfc74e74f50 (3100d694-97d1-4cd1-a004-5dfc74e74f50): created successfully Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d36710-32af-427a-be7c-ccbda93fc923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:08 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Flow 'volume_create_manager' (07735f65-a5bc-404f-b101-bcbc9082e957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:08 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-c0e2fdf7-6107-49a3-9bc3-fcefcc893407 tempest-CreateVolumesFromSnapshotTest-22309991 None] Created volume successfully. Jun 02 00:54:09 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182" returned: 0 in 0.868s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:09 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:54:09 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e3754c-4f55-4ec1-b616-0a7ec3375ebb]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:09 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b Jun 02 00:54:09 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:09 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-570a3eb6-b11f-4191-ab64-516fb15f2938 1073741824" returned: 0 in 0.969s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-570a3eb6-b11f-4191-ab64-516fb15f2938 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:09 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-570a3eb6-b11f-4191-ab64-516fb15f2938 Jun 02 00:54:09 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:10 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b" returned: 0 in 0.882s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:10 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182 Jun 02 00:54:10 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:10 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-570a3eb6-b11f-4191-ab64-516fb15f2938" returned: 0 in 0.770s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.120s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-947631592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5ea4c1-c7a0-4e56-99e0-19917c71355f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dca3deb9ce64f629c2e359723d49f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:04Z,use_quota=True,user_id='5cb38450cb4d4a6391a3ad213150cf8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Creating volume ce5ea4c1-c7a0-4e56-99e0-19917c71355f {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:54:10 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5ea4c1-c7a0-4e56-99e0-19917c71355f 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:10 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5ea4c1-c7a0-4e56-99e0-19917c71355f 1073741824 Jun 02 00:54:10 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b43f9e4-2406-469c-8091-a41873803047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-570a3eb6-b11f-4191-ab64-516fb15f2938', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1741f104-9faf-4f31-b5af-a26a33c47e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:10 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume volume-570a3eb6-b11f-4191-ab64-516fb15f2938 (570a3eb6-b11f-4191-ab64-516fb15f2938): created successfully Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1741f104-9faf-4f31-b5af-a26a33c47e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Flow 'volume_create_manager' (a3b0121f-f5c0-43ea-b0e8-dada028f8019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:10 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-9542b7f9-6880-4ca3-8f7d-2c95770afd6e tempest-CreateVolumesFromSnapshotTest-22309991 None] Created volume successfully. Jun 02 00:54:11 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:54:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Flow 'volume_create_manager' (c2d7ea2a-6ced-4291-89e9-881a5d9247ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a547328d-6cec-49cb-ae5a-1631456e5891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a547328d-6cec-49cb-ae5a-1631456e5891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-159930309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994ffdd3-17de-4b15-bad5-72c99bacfe2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0abea66a32b4626a6f6467d276baa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:11Z,use_quota=True,user_id='1ec8b5a7034f4f24b5f2d1fff4d798b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43713d6-17d0-4c78-b28b-b1f3831201e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43713d6-17d0-4c78-b28b-b1f3831201e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b93048-3b98-4b44-b8d9-2d04a7fb9fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b93048-3b98-4b44-b8d9-2d04a7fb9fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '994ffdd3-17de-4b15-bad5-72c99bacfe2b', 'volume_name': 'volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707021a5-16ca-4bd6-aa1f-02688a1392fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707021a5-16ca-4bd6-aa1f-02688a1392fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:11 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (751cd62c-912e-4941-82cf-e16a9a1453d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:11 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Volume 994ffdd3-17de-4b15-bad5-72c99bacfe2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b', 'volume_size': 1} Jun 02 00:54:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:11 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182" returned: 0 in 0.939s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:11 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182 Jun 02 00:54:11 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:11 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5ea4c1-c7a0-4e56-99e0-19917c71355f 1073741824" returned: 0 in 0.944s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5ea4c1-c7a0-4e56-99e0-19917c71355f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:11 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5ea4c1-c7a0-4e56-99e0-19917c71355f Jun 02 00:54:11 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:11 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b.29aa995f-22a0-48a6-a745-b51439afd182" returned: 0 in 0.705s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] Lock "cinder-quobyte-29aa995f-22a0-48a6-a745-b51439afd182" released by "_delete_snapshot" :: held 3.563s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] Lock "cinder-quobyte-5a7226b5-c4f0-4174-81e1-ef1d308e224b" released by "delete_snapshot" :: held 3.598s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] Created reservations ['45925758-63ef-4f83-91b5-f121dace7753', 'a907e9d7-12c5-4694-883a-93f553f112cb', '8790ce27-f6ed-4808-8667-0bc1e834c7ed', '0f4254fa-47f2-4003-a38b-9e49a1f60312'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:12 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] Delete snapshot completed successfully. Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-73d39adc-a85c-438f-9dcb-00de499d262a tempest-CinderUnicodeTest-803402313 None] Lock "cinder-29aa995f-22a0-48a6-a745-b51439afd182-delete_snapshot" released by "delete_snapshot" :: held 3.788s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:12 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5ea4c1-c7a0-4e56-99e0-19917c71355f" returned: 0 in 0.659s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.390s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-936807614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d299cd5d-21ec-4e7d-9556-beb65bd8519a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dca3deb9ce64f629c2e359723d49f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:05Z,use_quota=True,user_id='5cb38450cb4d4a6391a3ad213150cf8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Creating volume d299cd5d-21ec-4e7d-9556-beb65bd8519a {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:54:12 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d299cd5d-21ec-4e7d-9556-beb65bd8519a 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462109e2-8984-4e93-8c20-e3b08731cb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce5ea4c1-c7a0-4e56-99e0-19917c71355f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e9904a-a92f-4133-bdde-5bafb22a7f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:12 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d299cd5d-21ec-4e7d-9556-beb65bd8519a 1073741824 Jun 02 00:54:12 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:12 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume volume-ce5ea4c1-c7a0-4e56-99e0-19917c71355f (ce5ea4c1-c7a0-4e56-99e0-19917c71355f): created successfully Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e9904a-a92f-4133-bdde-5bafb22a7f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Flow 'volume_create_manager' (63319d60-0519-4c0e-bc3c-c3b55b7e9b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:12 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-b28bf324-b93a-44ba-8a5b-f38f388f7453 tempest-CreateVolumesFromSnapshotTest-22309991 None] Created volume successfully. Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] Acquiring lock "cinder-5a7226b5-c4f0-4174-81e1-ef1d308e224b-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] Lock "cinder-5a7226b5-c4f0-4174-81e1-ef1d308e224b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] Acquiring lock "cinder-quobyte-5a7226b5-c4f0-4174-81e1-ef1d308e224b" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] Lock "cinder-quobyte-5a7226b5-c4f0-4174-81e1-ef1d308e224b" acquired by "delete_volume" :: waited 0.023s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa244f41-e604-4385-8ae6-dc55a3719dea]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:12 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b Jun 02 00:54:12 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:13 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d299cd5d-21ec-4e7d-9556-beb65bd8519a 1073741824" returned: 0 in 0.866s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d299cd5d-21ec-4e7d-9556-beb65bd8519a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:13 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d299cd5d-21ec-4e7d-9556-beb65bd8519a Jun 02 00:54:13 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:13 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b" returned: 0 in 0.784s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:13 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b Jun 02 00:54:13 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:13 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d299cd5d-21ec-4e7d-9556-beb65bd8519a" returned: 0 in 0.643s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.503s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1644809322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bde5a84-913d-485d-88d7-801617d9cd4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dca3deb9ce64f629c2e359723d49f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:05Z,use_quota=True,user_id='5cb38450cb4d4a6391a3ad213150cf8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Creating volume 2bde5a84-913d-485d-88d7-801617d9cd4c {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:54:13 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2bde5a84-913d-485d-88d7-801617d9cd4c 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:13 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2bde5a84-913d-485d-88d7-801617d9cd4c 1073741824 Jun 02 00:54:13 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e8e7714-3dce-41c8-8a02-a1d983328057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d299cd5d-21ec-4e7d-9556-beb65bd8519a', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9f64c2-6d6d-41d2-81ed-b239dcd11aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:13 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume volume-d299cd5d-21ec-4e7d-9556-beb65bd8519a (d299cd5d-21ec-4e7d-9556-beb65bd8519a): created successfully Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9f64c2-6d6d-41d2-81ed-b239dcd11aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:13 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Flow 'volume_create_manager' (a13aa914-3e2f-4e54-97f5-0070ab335095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:13 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-6b62e5de-e4a4-45b3-a9c2-ba610ea64c88 tempest-CreateVolumesFromSnapshotTest-22309991 None] Created volume successfully. Jun 02 00:54:14 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-5a7226b5-c4f0-4174-81e1-ef1d308e224b" returned: 0 in 0.620s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] Lock "cinder-quobyte-5a7226b5-c4f0-4174-81e1-ef1d308e224b" released by "delete_volume" :: held 1.482s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:14 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] Created reservations ['746f0909-5dc6-46d5-a357-c6702a097f45', 'dcee0ee0-2d11-4854-852c-118a12b86a4c', '9ced5836-5176-496a-aa9d-bdf42872fd4d', 'fd5154aa-3eb2-4edc-919c-6f44f8d7ef52'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:14 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:14 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:14 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:14 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:14 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2bde5a84-913d-485d-88d7-801617d9cd4c 1073741824" returned: 0 in 0.840s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2bde5a84-913d-485d-88d7-801617d9cd4c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:14 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2bde5a84-913d-485d-88d7-801617d9cd4c Jun 02 00:54:14 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:14 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] Acquiring lock "cinder-021e2585-d92c-4011-849e-b72d0068e515-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] Lock "cinder-021e2585-d92c-4011-849e-b72d0068e515-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] Acquiring lock "cinder-quobyte-021e2585-d92c-4011-849e-b72d0068e515" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] Lock "cinder-quobyte-021e2585-d92c-4011-849e-b72d0068e515" acquired by "delete_volume" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:15 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.791s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:15 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] Deleted volume successfully. Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[54997a0b-7cf6-4d2c-89e0-7be43013d0bf]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-021e2585-d92c-4011-849e-b72d0068e515 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-106b1eae-2ec9-4266-9b82-b0cef2cd643e tempest-CinderUnicodeTest-803402313 None] Lock "cinder-5a7226b5-c4f0-4174-81e1-ef1d308e224b-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:15 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-021e2585-d92c-4011-849e-b72d0068e515 Jun 02 00:54:15 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:15 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:15 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:15 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2bde5a84-913d-485d-88d7-801617d9cd4c" returned: 0 in 0.763s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.317s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-159930309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994ffdd3-17de-4b15-bad5-72c99bacfe2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0abea66a32b4626a6f6467d276baa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:11Z,use_quota=True,user_id='1ec8b5a7034f4f24b5f2d1fff4d798b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Creating volume 994ffdd3-17de-4b15-bad5-72c99bacfe2b {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:54:15 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:15 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b 1073741824 Jun 02 00:54:15 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff92dda9-7747-4c78-8808-08b98e55677e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bde5a84-913d-485d-88d7-801617d9cd4c', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1bb8d9-bc8f-4ccd-8791-a0cf8bb09355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:15 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Volume volume-2bde5a84-913d-485d-88d7-801617d9cd4c (2bde5a84-913d-485d-88d7-801617d9cd4c): created successfully Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1bb8d9-bc8f-4ccd-8791-a0cf8bb09355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Flow 'volume_create_manager' (f2f0be10-4772-4452-9570-3c3f3bd02486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:15 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-63241ba2-fbfe-4e0b-9f0c-81c4cbc0e705 tempest-CreateVolumesFromSnapshotTest-22309991 None] Created volume successfully. Jun 02 00:54:15 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.704s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:15 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:16 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-021e2585-d92c-4011-849e-b72d0068e515" returned: 0 in 0.868s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-021e2585-d92c-4011-849e-b72d0068e515 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:16 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-021e2585-d92c-4011-849e-b72d0068e515 Jun 02 00:54:16 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "cinder-2bde5a84-913d-485d-88d7-801617d9cd4c-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-2bde5a84-913d-485d-88d7-801617d9cd4c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "cinder-quobyte-2bde5a84-913d-485d-88d7-801617d9cd4c" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-quobyte-2bde5a84-913d-485d-88d7-801617d9cd4c" acquired by "delete_volume" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[03024692-470e-4130-811a-393c56066dcd]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2bde5a84-913d-485d-88d7-801617d9cd4c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:16 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b 1073741824" returned: 0 in 1.036s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:16 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b Jun 02 00:54:16 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:54:16 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2bde5a84-913d-485d-88d7-801617d9cd4c Jun 02 00:54:16 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Flow 'volume_create_manager' (460a8fc3-77be-4b64-9b39-6564fea6daac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:16 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791cf327-4ed2-4e3b-8c91-fdf1e080ad88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-021e2585-d92c-4011-849e-b72d0068e515" returned: 0 in 0.718s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791cf327-4ed2-4e3b-8c91-fdf1e080ad88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d103ba9f-b0af-4d28-b792-693d4d912958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f378d29eb9b4f93b3eea554047905c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:17Z,use_quota=True,user_id='6c7cb9b86213408b83fca789314cae3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45ac532-bf69-4d75-86c0-af7ed9783487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45ac532-bf69-4d75-86c0-af7ed9783487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c456ee86-2660-4158-9163-a9f10a14beff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG cinder.image.glance [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Creating Keystone auth plugin from conf {{(pid=86910) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] Lock "cinder-quobyte-021e2585-d92c-4011-849e-b72d0068e515" released by "delete_volume" :: held 1.690s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] Created reservations ['524a6d40-0e04-4e13-8d22-27a0da2321f0', 'dd452010-47e0-4830-89aa-055e459ce498', '50ef438e-1347-4897-8510-d8a3318e3b91', 'aeffebd2-0861-429f-91ee-c4eca8384588'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:16 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:16 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c456ee86-2660-4158-9163-a9f10a14beff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd103ba9f-b0af-4d28-b792-693d4d912958', 'volume_name': 'volume-d103ba9f-b0af-4d28-b792-693d4d912958', 'volume_size': 1, 'image_id': '8355511c-37dd-437f-905f-19f027942e6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8355511c-37dd-437f-905f-19f027942e6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b441a9dc5573cd5b02afc29fa73bdc09', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f378d29eb9b4f93b3eea554047905c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e64799d9dbd698d25b06fa9ae1a20523ef3ff35d580c40982ffb6c3df728fb871ce95c80d53b24e7d5c883bb92569b530f552b5d0eede9dabdf0066809e329f0', 'id': '8355511c-37dd-437f-905f-19f027942e6e', 'created_at': datetime.datetime(2026, 6, 1, 22, 54, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 54, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8355511c-37dd-437f-905f-19f027942e6e/file', 'properties': {}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839e2acc-e6ff-41f5-b0fb-1f13086fcffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839e2acc-e6ff-41f5-b0fb-1f13086fcffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8a8372-fe48-48e5-9f62-aa5de3a7a680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:17 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Volume d103ba9f-b0af-4d28-b792-693d4d912958: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d103ba9f-b0af-4d28-b792-693d4d912958', 'volume_size': 1, 'image_id': '8355511c-37dd-437f-905f-19f027942e6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8355511c-37dd-437f-905f-19f027942e6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b441a9dc5573cd5b02afc29fa73bdc09', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f378d29eb9b4f93b3eea554047905c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e64799d9dbd698d25b06fa9ae1a20523ef3ff35d580c40982ffb6c3df728fb871ce95c80d53b24e7d5c883bb92569b530f552b5d0eede9dabdf0066809e329f0', 'id': '8355511c-37dd-437f-905f-19f027942e6e', 'created_at': datetime.datetime(2026, 6, 1, 22, 54, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 54, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8355511c-37dd-437f-905f-19f027942e6e/file', 'properties': {}}, 'image_service': } Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Trying to clone d103ba9f-b0af-4d28-b792-693d4d912958 from image 8355511c-37dd-437f-905f-19f027942e6e at location (None, [{'url': 'file:///opt/stack/data/glance/images/8355511c-37dd-437f-905f-19f027942e6e', 'metadata': {}}]). {{(pid=86910) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 02 00:54:17 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Image download 0.00 MB at 0.00 MB/s Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dad0e5c-216f-4e49-a410-5825016be101]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:17 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b" returned: 0 in 0.779s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:17 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:17 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD Jun 02 00:54:17 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2bde5a84-913d-485d-88d7-801617d9cd4c" returned: 0 in 0.886s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2bde5a84-913d-485d-88d7-801617d9cd4c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (751cd62c-912e-4941-82cf-e16a9a1453d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908e03fc-2699-4461-ae0a-76e5cfcf48d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:17 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2bde5a84-913d-485d-88d7-801617d9cd4c Jun 02 00:54:17 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:17 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Volume volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b (994ffdd3-17de-4b15-bad5-72c99bacfe2b): created successfully Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908e03fc-2699-4461-ae0a-76e5cfcf48d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Flow 'volume_create_manager' (c2d7ea2a-6ced-4291-89e9-881a5d9247ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:17 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-44fb9282-2de1-4f22-905f-ed05f5bfc28e tempest-VolumeDependencyTests-1749638996 None] Created volume successfully. Jun 02 00:54:17 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.730s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:17 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] Deleted volume successfully. Jun 02 00:54:17 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-de947069-bec7-4258-b75f-d4c893734193 tempest-CinderUnicodeTest-803402313 None] Lock "cinder-021e2585-d92c-4011-849e-b72d0068e515-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:18 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD" returned: 0 in 0.802s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:18 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2bde5a84-913d-485d-88d7-801617d9cd4c" returned: 0 in 0.735s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:18 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-quobyte-2bde5a84-913d-485d-88d7-801617d9cd4c" released by "delete_volume" :: held 1.681s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:18 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD Jun 02 00:54:18 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:18 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] Created reservations ['5721fff9-5ad9-4ba8-a5b4-fff5158679ed', 'f33d5d2c-148a-4a9e-b889-e065156178c4', 'f7c7c167-383d-4929-b932-bcaa372e8302', '4d05fa65-6235-4fcf-8a53-409a43a09285'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:18 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:18 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:18 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:18 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:18 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "cinder-d299cd5d-21ec-4e7d-9556-beb65bd8519a-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:18 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-d299cd5d-21ec-4e7d-9556-beb65bd8519a-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "cinder-quobyte-d299cd5d-21ec-4e7d-9556-beb65bd8519a" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:19 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.715s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:19 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-quobyte-d299cd5d-21ec-4e7d-9556-beb65bd8519a" acquired by "delete_volume" :: waited 0.044s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:19 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] Deleted volume successfully. Jun 02 00:54:19 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:19 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-16de682a-3573-4ed3-bf28-5847e02d8a89 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-2bde5a84-913d-485d-88d7-801617d9cd4c-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:19 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06709c0-de80-4380-a3b4-ab7bfafd9bcd]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d299cd5d-21ec-4e7d-9556-beb65bd8519a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD" returned: 1 in 1.047s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:54:19 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Temporary image 8355511c-37dd-437f-905f-19f027942e6e is fetched for user 6c7cb9b86213408b83fca789314cae3d. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 02 00:54:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:19 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] Creating offline snapshot 34b43b80-342f-4c59-bb60-d715c14753ae of volume 994ffdd3-17de-4b15-bad5-72c99bacfe2b {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:54:19 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5100395-ceb2-41fd-bac3-1fa21e69b068]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:19 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d299cd5d-21ec-4e7d-9556-beb65bd8519a Jun 02 00:54:19 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:19 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c263c565-dca9-4373-b794-526ba3830c29]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:19 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:19 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b Jun 02 00:54:19 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:19 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD Jun 02 00:54:19 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:20 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d299cd5d-21ec-4e7d-9556-beb65bd8519a" returned: 0 in 0.935s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d299cd5d-21ec-4e7d-9556-beb65bd8519a {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:20 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d299cd5d-21ec-4e7d-9556-beb65bd8519a Jun 02 00:54:20 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:20 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b" returned: 0 in 0.975s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:20 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae 1G Jun 02 00:54:20 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:20 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD" returned: 0 in 1.002s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:20 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD Jun 02 00:54:20 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:20 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:20 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d299cd5d-21ec-4e7d-9556-beb65bd8519a" returned: 0 in 0.689s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:20 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-quobyte-d299cd5d-21ec-4e7d-9556-beb65bd8519a" released by "delete_volume" :: held 1.721s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:20 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] Created reservations ['453c2a4e-c98e-47a8-9faa-11fa9e7383dc', '89cb66ba-7e9c-4663-bbdb-829b46d03e67', '5f7a4228-68ca-41cc-8825-888f3da56860', 'da6793af-16c1-4913-8184-140c6f41e2cc'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:21 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:21 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:21 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD" returned: 1 in 0.799s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:21 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae 1G" returned: 0 in 0.951s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:21 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae Jun 02 00:54:21 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "cinder-ce5ea4c1-c7a0-4e56-99e0-19917c71355f-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-ce5ea4c1-c7a0-4e56-99e0-19917c71355f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "cinder-quobyte-ce5ea4c1-c7a0-4e56-99e0-19917c71355f" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-quobyte-ce5ea4c1-c7a0-4e56-99e0-19917c71355f" acquired by "delete_volume" :: waited 0.016s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[565ae37f-d798-4e47-90d6-259f4e5935a6]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5ea4c1-c7a0-4e56-99e0-19917c71355f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:21 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5ea4c1-c7a0-4e56-99e0-19917c71355f Jun 02 00:54:21 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:21 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.732s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:21 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] Deleted volume successfully. Jun 02 00:54:21 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-33dbdaf5-99a7-46f6-9e29-5f01f978b543 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-d299cd5d-21ec-4e7d-9556-beb65bd8519a-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:22 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae" returned: 0 in 0.817s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:22 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae is being set with open permissions: ugo+rw Jun 02 00:54:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:22 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae Jun 02 00:54:22 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:22 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5ea4c1-c7a0-4e56-99e0-19917c71355f" returned: 0 in 0.835s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5ea4c1-c7a0-4e56-99e0-19917c71355f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:22 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5ea4c1-c7a0-4e56-99e0-19917c71355f Jun 02 00:54:22 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:22 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae" returned: 0 in 0.662s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:22 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.info Jun 02 00:54:22 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:22 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-ce5ea4c1-c7a0-4e56-99e0-19917c71355f" returned: 0 in 0.624s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:22 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:22 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-quobyte-ce5ea4c1-c7a0-4e56-99e0-19917c71355f" released by "delete_volume" :: held 1.510s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] Created reservations ['c11d6b70-c14f-45f3-9d47-fe096a1d53dc', '09108648-e450-460d-8d14-1a492b93273c', '91997f2a-f63a-4b25-8c2c-394f718e09ef', 'e5e693d4-e5af-4811-831c-5f3ea82fbe09'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:23 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:23 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:23 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.info" returned: 0 in 0.641s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:23 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.info is being set with open permissions: ugo+rw Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:23 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.info Jun 02 00:54:23 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "cinder-570a3eb6-b11f-4191-ab64-516fb15f2938-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-570a3eb6-b11f-4191-ab64-516fb15f2938-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "cinder-quobyte-570a3eb6-b11f-4191-ab64-516fb15f2938" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-quobyte-570a3eb6-b11f-4191-ab64-516fb15f2938" acquired by "delete_volume" :: waited 0.035s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1086c8-5bd9-4799-8f2c-6e913e7e71b6]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:23 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-570a3eb6-b11f-4191-ab64-516fb15f2938 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.684s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:23 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] Deleted volume successfully. Jun 02 00:54:23 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d293915f-5cb9-4d29-946b-60b9d68528d4 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-ce5ea4c1-c7a0-4e56-99e0-19917c71355f-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:23 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-570a3eb6-b11f-4191-ab64-516fb15f2938 Jun 02 00:54:23 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:24 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.info" returned: 0 in 0.774s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.938s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.057s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d103ba9f-b0af-4d28-b792-693d4d912958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f378d29eb9b4f93b3eea554047905c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:17Z,use_quota=True,user_id='6c7cb9b86213408b83fca789314cae3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:54:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Creating volume d103ba9f-b0af-4d28-b792-693d4d912958 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:54:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:24 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:54:24 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:54:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:24 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 1073741824 Jun 02 00:54:24 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:24 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-2ded01a3-beb1-4a35-a903-91635e761b9c tempest-VolumeDependencyTests-1749638996 None] Create snapshot completed successfully Jun 02 00:54:24 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-570a3eb6-b11f-4191-ab64-516fb15f2938" returned: 0 in 0.845s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:24 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-570a3eb6-b11f-4191-ab64-516fb15f2938 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:24 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-570a3eb6-b11f-4191-ab64-516fb15f2938 Jun 02 00:54:24 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:54:25 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 1073741824" returned: 0 in 0.990s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Flow 'volume_create_manager' (e97c58d8-edb8-4385-a96a-1dbea76e5767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383f3097-ddbf-4b51-b2e4-7486c3ae21d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383f3097-ddbf-4b51-b2e4-7486c3ae21d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-354805712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f43ff6c9-c574-49b6-ba5a-9793818b1572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0abea66a32b4626a6f6467d276baa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=34b43b80-342f-4c59-bb60-d715c14753ae,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:25Z,use_quota=True,user_id='1ec8b5a7034f4f24b5f2d1fff4d798b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a858869-110a-4066-960f-413f9e6e3e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a858869-110a-4066-960f-413f9e6e3e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0edbf20b-b20f-45ef-a6e0-e34e7a845829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0edbf20b-b20f-45ef-a6e0-e34e7a845829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f43ff6c9-c574-49b6-ba5a-9793818b1572', 'volume_name': 'volume-f43ff6c9-c574-49b6-ba5a-9793818b1572', 'volume_size': 1, 'snapshot_id': '34b43b80-342f-4c59-bb60-d715c14753ae'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:25 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab95ffde-e91d-4921-b01b-ca58098c0330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab95ffde-e91d-4921-b01b-ca58098c0330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3335f84-7da2-498a-b602-a3fc4e7acb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:25 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Volume f43ff6c9-c574-49b6-ba5a-9793818b1572: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f43ff6c9-c574-49b6-ba5a-9793818b1572', 'volume_size': 1, 'snapshot_id': '34b43b80-342f-4c59-bb60-d715c14753ae'} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-570a3eb6-b11f-4191-ab64-516fb15f2938" returned: 0 in 0.695s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-quobyte-570a3eb6-b11f-4191-ab64-516fb15f2938" released by "delete_volume" :: held 1.597s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:25 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 Jun 02 00:54:25 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] Created reservations ['ddffdb20-b5bb-4527-8bb3-d69ef620272c', '79678abb-eb84-4cb2-9f52-c0b092eb31b9', 'ed40a902-33c5-423c-a465-0061e45b53e3', 'cb73fedb-cfd6-4ff1-9d5e-369eb13fdf55'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:25 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:25 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:25 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "cinder-3100d694-97d1-4cd1-a004-5dfc74e74f50-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-3100d694-97d1-4cd1-a004-5dfc74e74f50-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "cinder-quobyte-3100d694-97d1-4cd1-a004-5dfc74e74f50" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-quobyte-3100d694-97d1-4cd1-a004-5dfc74e74f50" acquired by "delete_volume" :: waited 0.027s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e3d63c-1f03-445b-bbcb-ab748e358efb]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3100d694-97d1-4cd1-a004-5dfc74e74f50 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:26 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958" returned: 0 in 0.909s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.035s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.935s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Acquiring lock "cinder-quobyte-34b43b80-342f-4c59-bb60-d715c14753ae-f43ff6c9-c574-49b6-ba5a-9793818b1572" by "_create_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-quobyte-34b43b80-342f-4c59-bb60-d715c14753ae-f43ff6c9-c574-49b6-ba5a-9793818b1572" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Creating volume f43ff6c9-c574-49b6-ba5a-9793818b1572 from snapshot 34b43b80-342f-4c59-bb60-d715c14753ae {{(pid=86910) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 00:54:26 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3100d694-97d1-4cd1-a004-5dfc74e74f50 Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:26 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Acquiring lock "cinder-quobyte-f43ff6c9-c574-49b6-ba5a-9793818b1572" by "_copy_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Attempting download of 8355511c-37dd-437f-905f-19f027942e6e ((None, [{'url': 'file:///opt/stack/data/glance/images/8355511c-37dd-437f-905f-19f027942e6e', 'metadata': {}}])) to volume d103ba9f-b0af-4d28-b792-693d4d912958. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-quobyte-f43ff6c9-c574-49b6-ba5a-9793818b1572" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] snapshot: 34b43b80-342f-4c59-bb60-d715c14753ae, volume: f43ff6c9-c574-49b6-ba5a-9793818b1572, {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:26 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[090ae00f-eee3-4286-8361-1c41895af31f]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bb8e49-6845-47f5-a032-8259efd78044]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8355511c-37dd-437f-905f-19f027942e6e_8lv5lo8y {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.934s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:26 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] Deleted volume successfully. Jun 02 00:54:26 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-04197a08-9e03-4b25-86f2-0a31cebe7ecd tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-570a3eb6-b11f-4191-ab64-516fb15f2938-delete_volume" released by "delete_volume" :: held 2.877s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:26 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae Jun 02 00:54:26 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:26 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8355511c-37dd-437f-905f-19f027942e6e_8lv5lo8y Jun 02 00:54:26 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:27 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3100d694-97d1-4cd1-a004-5dfc74e74f50" returned: 0 in 0.885s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3100d694-97d1-4cd1-a004-5dfc74e74f50 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:27 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3100d694-97d1-4cd1-a004-5dfc74e74f50 Jun 02 00:54:27 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:27 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8355511c-37dd-437f-905f-19f027942e6e_8lv5lo8y" returned: 0 in 0.804s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8355511c-37dd-437f-905f-19f027942e6e_8lv5lo8y {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:27 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8355511c-37dd-437f-905f-19f027942e6e_8lv5lo8y Jun 02 00:54:27 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:27 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae" returned: 0 in 0.983s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:54:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 00:54:27 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Creating direct copy from snapshot {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 00:54:27 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[863b4a71-243d-44c1-9f00-fddec789992f]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:27 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b Jun 02 00:54:27 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:27 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:27 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-3100d694-97d1-4cd1-a004-5dfc74e74f50" returned: 0 in 0.804s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:27 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-quobyte-3100d694-97d1-4cd1-a004-5dfc74e74f50" released by "delete_volume" :: held 1.750s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:27 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] Created reservations ['6f57cfcb-5e31-4a9d-a987-0a3607a110c7', '37cbd825-07e2-43e6-830b-d0bf1210dc68', '4873eff2-ea1b-4bd3-a0c2-77a502c1b39f', 'f77e4cb7-7e8c-44bd-9953-bf1c729b9273'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:28 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:28 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:28 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8355511c-37dd-437f-905f-19f027942e6e_8lv5lo8y" returned: 1 in 0.905s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8355511c-37dd-437f-905f-19f027942e6e_8lv5lo8y' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df12f03-3663-4fc2-a0be-fba9eec70a82]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:28 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD Jun 02 00:54:28 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "cinder-35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "cinder-quobyte-a8b69d25-aec4-452d-81fc-59ee395693f3" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:28 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b" returned: 0 in 1.046s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG cinder.utils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Path /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f43ff6c9-c574-49b6-ba5a-9793818b1572 not found in is_blk_device check {{(pid=86910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f43ff6c9-c574-49b6-ba5a-9793818b1572 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-quobyte-a8b69d25-aec4-452d-81fc-59ee395693f3" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "cinder-quobyte-35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-quobyte-35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:28 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f43ff6c9-c574-49b6-ba5a-9793818b1572 Jun 02 00:54:28 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] Deleting offline snapshot 35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32 of volume a8b69d25-aec4-452d-81fc-59ee395693f3 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] snapshot_file for this snap is: volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[021c42a8-2a24-4579-b6de-8e421a3efb77]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:28 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32 Jun 02 00:54:28 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:28 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.942s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:28 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:28 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] Deleted volume successfully. Jun 02 00:54:29 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-28e09c68-def5-47c5-96cb-e359b79b4907 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-3100d694-97d1-4cd1-a004-5dfc74e74f50-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:29 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD" returned: 0 in 0.917s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:29 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:29 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD Jun 02 00:54:29 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:30 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32" returned: 0 in 1.877s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:30 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8b69d25-aec4-452d-81fc-59ee395693f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:54:30 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[470c21ac-c282-4e2d-a2e4-8860fe1b349e]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:30 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD" returned: 1 in 1.733s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:54:30 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] 8355511c-37dd-437f-905f-19f027942e6e was raw, converting to raw {{(pid=86910) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 02 00:54:30 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:30 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3 Jun 02 00:54:30 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:30 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 Jun 02 00:54:30 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:32 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3" returned: 0 in 2.059s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:32 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:32 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32 Jun 02 00:54:32 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:33 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958" returned: 0 in 2.511s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:33 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8355511c-37dd-437f-905f-19f027942e6e_j8rdg8hmdevstack@QuobyteHD, size 0.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:54:33 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Converted 0.00 MB image at 0.00 MB/s Jun 02 00:54:33 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:33 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 1G Jun 02 00:54:33 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:34 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32" returned: 0 in 1.798s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:34 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:34 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32 Jun 02 00:54:34 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:35 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 1G" returned: 0 in 1.697s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:35 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f43ff6c9-c574-49b6-ba5a-9793818b1572" returned: 0 in 6.582s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:35 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8a1fb9-f3c0-46cc-a100-97f4c39fe2f8]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:35 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f962272-015e-43ba-ba4b-16021219ead9]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:35 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 Jun 02 00:54:35 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:35 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b Jun 02 00:54:35 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:35 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:35 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3.35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32" returned: 0 in 1.056s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-quobyte-35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32" released by "_delete_snapshot" :: held 7.078s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-quobyte-a8b69d25-aec4-452d-81fc-59ee395693f3" released by "delete_snapshot" :: held 7.112s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:35 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] Created reservations ['c2c8aa0f-d1f3-4284-959b-d4c97c92d869', '761437fe-5499-4f0e-ac04-8b1c07169e5e', '14c8c07d-ef36-4035-9cea-327c14abc894', 'e018a33d-bb8a-47f0-bc7b-8c1dd992732b'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:35 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] Delete snapshot completed successfully. Jun 02 00:54:35 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-3cbd544b-96a6-401d-9912-ca6417c19c54 tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-35ad7c8a-e1bb-4af6-8e8e-9fc691d9cf32-delete_snapshot" released by "delete_snapshot" :: held 7.337s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:35 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958" returned: 0 in 0.894s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "cinder-a8b69d25-aec4-452d-81fc-59ee395693f3-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-a8b69d25-aec4-452d-81fc-59ee395693f3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:36 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 Jun 02 00:54:36 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "cinder-quobyte-a8b69d25-aec4-452d-81fc-59ee395693f3" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-quobyte-a8b69d25-aec4-452d-81fc-59ee395693f3" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:36 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b" returned: 0 in 1.192s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c2a9ae-89fe-4170-9887-75e1c9f16983]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Image conversion details: src /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b, size 1024.00 MB, duration 6.58 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f43ff6c9-c574-49b6-ba5a-9793818b1572 {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:54:36 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Converted 1024.00 MB image at 155.57 MB/s Jun 02 00:54:36 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f43ff6c9-c574-49b6-ba5a-9793818b1572 is being set with open permissions: ugo+rw Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f43ff6c9-c574-49b6-ba5a-9793818b1572 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:36 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f43ff6c9-c574-49b6-ba5a-9793818b1572 Jun 02 00:54:36 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:36 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3 Jun 02 00:54:36 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:36 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958" returned: 1 in 0.866s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Downloaded image 8355511c-37dd-437f-905f-19f027942e6e ((None, [{'url': 'file:///opt/stack/data/glance/images/8355511c-37dd-437f-905f-19f027942e6e', 'metadata': {}}])) to volume d103ba9f-b0af-4d28-b792-693d4d912958 successfully. {{(pid=86910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Temporary image 8355511c-37dd-437f-905f-19f027942e6e for user 6c7cb9b86213408b83fca789314cae3d is deleted. {{(pid=86910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG cinder.volume.volume_utils [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Marking volume d103ba9f-b0af-4d28-b792-693d4d912958 as bootable. {{(pid=86910) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Copying metadata from image 8355511c-37dd-437f-905f-19f027942e6e to d103ba9f-b0af-4d28-b792-693d4d912958. {{(pid=86910) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Creating volume glance metadata for volume d103ba9f-b0af-4d28-b792-693d4d912958 backed by image 8355511c-37dd-437f-905f-19f027942e6e with: {'image_id': '8355511c-37dd-437f-905f-19f027942e6e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b441a9dc5573cd5b02afc29fa73bdc09', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86910) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 00:54:36 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:36 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f43ff6c9-c574-49b6-ba5a-9793818b1572" returned: 0 in 0.713s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-quobyte-f43ff6c9-c574-49b6-ba5a-9793818b1572" released by "_copy_volume_from_snapshot" :: held 10.680s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-quobyte-34b43b80-342f-4c59-bb60-d715c14753ae-f43ff6c9-c574-49b6-ba5a-9793818b1572" released by "_create_volume_from_snapshot" :: held 10.741s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.769s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8a8372-fe48-48e5-9f62-aa5de3a7a680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d103ba9f-b0af-4d28-b792-693d4d912958', 'volume_size': 1, 'image_id': '8355511c-37dd-437f-905f-19f027942e6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8355511c-37dd-437f-905f-19f027942e6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b441a9dc5573cd5b02afc29fa73bdc09', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f378d29eb9b4f93b3eea554047905c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e64799d9dbd698d25b06fa9ae1a20523ef3ff35d580c40982ffb6c3df728fb871ce95c80d53b24e7d5c883bb92569b530f552b5d0eede9dabdf0066809e329f0', 'id': '8355511c-37dd-437f-905f-19f027942e6e', 'created_at': datetime.datetime(2026, 6, 1, 22, 54, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 22, 54, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8355511c-37dd-437f-905f-19f027942e6e/file', 'properties': {}}, 'image_service': }' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a3f585-aa3b-41b9-b6ff-08f1b3e1c3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:37 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Volume volume-d103ba9f-b0af-4d28-b792-693d4d912958 (d103ba9f-b0af-4d28-b792-693d4d912958): created successfully Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a3f585-aa3b-41b9-b6ff-08f1b3e1c3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Flow 'volume_create_manager' (460a8fc3-77be-4b64-9b39-6564fea6daac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:37 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3335f84-7da2-498a-b602-a3fc4e7acb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f43ff6c9-c574-49b6-ba5a-9793818b1572', 'volume_size': 1, 'snapshot_id': '34b43b80-342f-4c59-bb60-d715c14753ae'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a023e3f-d17e-4391-abe2-fbbceb17b687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3" returned: 0 in 0.823s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:37 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-0b9079cf-c181-4022-8197-93ac16413084 tempest-VolumeImageDependencyTests-1782658234 None] Created volume successfully. Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:37 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Volume volume-f43ff6c9-c574-49b6-ba5a-9793818b1572 (f43ff6c9-c574-49b6-ba5a-9793818b1572): created successfully Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a023e3f-d17e-4391-abe2-fbbceb17b687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Flow 'volume_create_manager' (e97c58d8-edb8-4385-a96a-1dbea76e5767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:37 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3 Jun 02 00:54:37 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:37 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-7efdf397-ecbd-4267-b1f3-ad9fc0a19263 tempest-VolumeDependencyTests-1749638996 None] Created volume successfully. Jun 02 00:54:37 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a8b69d25-aec4-452d-81fc-59ee395693f3" returned: 0 in 0.625s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-quobyte-a8b69d25-aec4-452d-81fc-59ee395693f3" released by "delete_volume" :: held 1.537s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] Created reservations ['3e9de12b-4833-439e-a4a4-c6527ec74057', 'e40f88bb-5031-4f59-923e-2556da59176c', '351cdb41-68c2-4192-8aa4-11fffc31719b', '185f4d38-934b-45b0-9ace-7fad99d39e8a'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:37 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:37 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:37 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Acquiring lock "cinder-d103ba9f-b0af-4d28-b792-693d4d912958-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Lock "cinder-d103ba9f-b0af-4d28-b792-693d4d912958-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] Acquiring lock "cinder-34b43b80-342f-4c59-bb60-d715c14753ae-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Acquiring lock "cinder-quobyte-d103ba9f-b0af-4d28-b792-693d4d912958" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-34b43b80-342f-4c59-bb60-d715c14753ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] Acquiring lock "cinder-quobyte-994ffdd3-17de-4b15-bad5-72c99bacfe2b" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Lock "cinder-quobyte-d103ba9f-b0af-4d28-b792-693d4d912958" acquired by "delete_volume" :: waited 0.033s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-quobyte-994ffdd3-17de-4b15-bad5-72c99bacfe2b" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] Acquiring lock "cinder-quobyte-34b43b80-342f-4c59-bb60-d715c14753ae" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-quobyte-34b43b80-342f-4c59-bb60-d715c14753ae" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] Deleting offline snapshot 34b43b80-342f-4c59-bb60-d715c14753ae of volume 994ffdd3-17de-4b15-bad5-72c99bacfe2b {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] snapshot_file for this snap is: volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb74433b-28bb-4a42-941d-71d99aff4881]: (4, 'raw') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2a13bb-d87a-477c-ac7b-524de691c57d]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:38 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae Jun 02 00:54:38 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:38 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 Jun 02 00:54:38 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:38 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.849s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:38 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] Deleted volume successfully. Jun 02 00:54:38 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-c756c28e-0162-4f77-a301-1140dbcf62da tempest-CreateVolumesFromSnapshotTest-22309991 None] Lock "cinder-a8b69d25-aec4-452d-81fc-59ee395693f3-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:39 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae" returned: 0 in 0.843s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:39 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:54:39 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:39 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5643b619-107c-44e8-a805-47cca62d6dee]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958" returned: 0 in 0.919s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:39 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:39 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b Jun 02 00:54:39 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:39 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 Jun 02 00:54:39 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:40 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b" returned: 0 in 0.780s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:40 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958" returned: 1 in 0.785s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958' failed. Not Retrying. {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 00:54:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:40 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae Jun 02 00:54:40 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:40 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958 Jun 02 00:54:40 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:40 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d103ba9f-b0af-4d28-b792-693d4d912958" returned: 0 in 0.796s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:40 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae" returned: 0 in 0.836s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:40 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:40 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Lock "cinder-quobyte-d103ba9f-b0af-4d28-b792-693d4d912958" released by "delete_volume" :: held 2.640s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:40 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae Jun 02 00:54:40 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:41 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Created reservations ['7134262c-c7e9-42c9-bce0-e143b1def965', 'd2d69a45-c478-40a5-93c8-9cbbbc58d7fc', '12839e86-a273-4ad6-85af-15a9a497ff5e', '1fe0ca01-c4bd-48f7-bd7e-6fb003a1330b'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:41 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:41 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:41 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:41 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:41 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b.34b43b80-342f-4c59-bb60-d715c14753ae" returned: 0 in 0.895s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:41 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:UPDATE=190,cinder:SELECT=139,cinder:INSERT=55,cinder:DELETE=18 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:54:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-quobyte-34b43b80-342f-4c59-bb60-d715c14753ae" released by "_delete_snapshot" :: held 3.514s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:41 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:41 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.745s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:41 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-quobyte-994ffdd3-17de-4b15-bad5-72c99bacfe2b" released by "delete_snapshot" :: held 3.558s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:41 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Deleted volume successfully. Jun 02 00:54:41 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b4c4073f-e2ea-4271-af8b-9d97b8e19d54 tempest-VolumeImageDependencyTests-1782658234 None] Lock "cinder-d103ba9f-b0af-4d28-b792-693d4d912958-delete_volume" released by "delete_volume" :: held 3.749s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:41 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] Created reservations ['9283b7f8-cd00-486e-9ea6-2ffd59c46c8e', '788c0e26-5eae-4aeb-98ce-af426b482470', '974c9c89-8c02-4a72-aea4-ecce59e210ec', '6bcb1ad5-91af-4e8d-92f4-f15a2ad0d124'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:42 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] Delete snapshot completed successfully. Jun 02 00:54:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-f7dd48b3-1081-43db-96cd-3a8da1337612 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-34b43b80-342f-4c59-bb60-d715c14753ae-delete_snapshot" released by "delete_snapshot" :: held 3.787s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] Acquiring lock "cinder-994ffdd3-17de-4b15-bad5-72c99bacfe2b-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-994ffdd3-17de-4b15-bad5-72c99bacfe2b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:42 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=154,cinder:UPDATE=193,cinder:INSERT=53,cinder:DELETE=17 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:54:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] Acquiring lock "cinder-quobyte-994ffdd3-17de-4b15-bad5-72c99bacfe2b" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:42 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-quobyte-994ffdd3-17de-4b15-bad5-72c99bacfe2b" acquired by "delete_volume" :: waited 0.034s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:42 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b35e49-9c66-42b6-a1d2-4778a2f93ae3]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:42 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:42 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b Jun 02 00:54:42 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Flow 'volume_create_manager' (9de6b72a-b625-476c-89ff-60bd30c156f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05c8836-642a-4ada-bc3f-0568f671d077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05c8836-642a-4ada-bc3f-0568f671d077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1650244914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c70d97f-d31e-489b-943f-1cee2c8cbaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bdccfe5b00843a3923bbad65e604212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:43Z,use_quota=True,user_id='0224e76ee5f9481e80668f2649a5b43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d9dd65-bd02-44b0-b723-ea879065b58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d9dd65-bd02-44b0-b723-ea879065b58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aabb51-7969-4d8e-9182-643d84847d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aabb51-7969-4d8e-9182-643d84847d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c70d97f-d31e-489b-943f-1cee2c8cbaad', 'volume_name': 'volume-8c70d97f-d31e-489b-943f-1cee2c8cbaad', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92aeee5c-0a25-4e8f-aa27-4d591e973de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92aeee5c-0a25-4e8f-aa27-4d591e973de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1395c04e-cbaf-4df7-a4ee-151838eb7e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:43 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume 8c70d97f-d31e-489b-943f-1cee2c8cbaad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c70d97f-d31e-489b-943f-1cee2c8cbaad', 'volume_size': 1} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1650244914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c70d97f-d31e-489b-943f-1cee2c8cbaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bdccfe5b00843a3923bbad65e604212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:43Z,use_quota=True,user_id='0224e76ee5f9481e80668f2649a5b43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Creating volume 8c70d97f-d31e-489b-943f-1cee2c8cbaad {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:54:43 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8c70d97f-d31e-489b-943f-1cee2c8cbaad 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:43 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8c70d97f-d31e-489b-943f-1cee2c8cbaad 1073741824 Jun 02 00:54:43 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:43 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b" returned: 0 in 1.017s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:43 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:43 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b Jun 02 00:54:43 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:44 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-994ffdd3-17de-4b15-bad5-72c99bacfe2b" returned: 0 in 0.720s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-quobyte-994ffdd3-17de-4b15-bad5-72c99bacfe2b" released by "delete_volume" :: held 1.833s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:44 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8c70d97f-d31e-489b-943f-1cee2c8cbaad 1073741824" returned: 0 in 0.998s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:44 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] Created reservations ['fda03aba-8ea6-4bdf-a2e2-01e042279c05', 'f872b610-bc19-4e58-b775-a0e661a7a7b7', '11fdbfbb-ae86-4c2c-b54f-0ecb6a233ece', '187b16d5-9054-418c-94f8-1a36e7cd5008'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8c70d97f-d31e-489b-943f-1cee2c8cbaad {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:44 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8c70d97f-d31e-489b-943f-1cee2c8cbaad Jun 02 00:54:44 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:44 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:44 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:44 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:44 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] Acquiring lock "cinder-f43ff6c9-c574-49b6-ba5a-9793818b1572-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-f43ff6c9-c574-49b6-ba5a-9793818b1572-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] Acquiring lock "cinder-quobyte-f43ff6c9-c574-49b6-ba5a-9793818b1572" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:44 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-quobyte-f43ff6c9-c574-49b6-ba5a-9793818b1572" acquired by "delete_volume" :: waited 0.022s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:45 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e005f612-17af-43bb-8bec-20190809787b]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f43ff6c9-c574-49b6-ba5a-9793818b1572 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:45 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f43ff6c9-c574-49b6-ba5a-9793818b1572 Jun 02 00:54:45 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:45 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8c70d97f-d31e-489b-943f-1cee2c8cbaad" returned: 0 in 0.721s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:45 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:54:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1395c04e-cbaf-4df7-a4ee-151838eb7e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c70d97f-d31e-489b-943f-1cee2c8cbaad', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6003f77-49c1-4e28-b4ef-261574580217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:45 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume volume-8c70d97f-d31e-489b-943f-1cee2c8cbaad (8c70d97f-d31e-489b-943f-1cee2c8cbaad): created successfully Jun 02 00:54:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6003f77-49c1-4e28-b4ef-261574580217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:45 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Flow 'volume_create_manager' (9de6b72a-b625-476c-89ff-60bd30c156f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:45 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-a4a77b4d-dd4d-42e9-be2d-e907b107d3cf tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Created volume successfully. Jun 02 00:54:45 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.822s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:45 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:45 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] Deleted volume successfully. Jun 02 00:54:45 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cd55c0e0-6105-433b-a6c9-7d6d52a73e71 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-994ffdd3-17de-4b15-bad5-72c99bacfe2b-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:45 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f43ff6c9-c574-49b6-ba5a-9793818b1572" returned: 0 in 0.906s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:45 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f43ff6c9-c574-49b6-ba5a-9793818b1572 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:45 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f43ff6c9-c574-49b6-ba5a-9793818b1572 Jun 02 00:54:45 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Flow 'volume_create_manager' (692d7304-0573-426c-a08f-eaf6afa8318e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a220ce6d-ec60-431e-a3f0-54623992681e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a220ce6d-ec60-431e-a3f0-54623992681e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1555220116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef3ed86-b709-4572-a5c2-e1277c5b023c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bdccfe5b00843a3923bbad65e604212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:46Z,use_quota=True,user_id='0224e76ee5f9481e80668f2649a5b43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51db6ae-1bcd-4611-bb09-b0b9626d9fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51db6ae-1bcd-4611-bb09-b0b9626d9fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268fab86-b1c5-4617-a576-98c6cd2fe386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268fab86-b1c5-4617-a576-98c6cd2fe386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef3ed86-b709-4572-a5c2-e1277c5b023c', 'volume_name': 'volume-2ef3ed86-b709-4572-a5c2-e1277c5b023c', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767646ed-32eb-4625-9a58-5d57bd16bf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767646ed-32eb-4625-9a58-5d57bd16bf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2248df47-e8e8-4edd-b487-9bcd7b0c6b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:46 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume 2ef3ed86-b709-4572-a5c2-e1277c5b023c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef3ed86-b709-4572-a5c2-e1277c5b023c', 'volume_size': 1} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1555220116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef3ed86-b709-4572-a5c2-e1277c5b023c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bdccfe5b00843a3923bbad65e604212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:46Z,use_quota=True,user_id='0224e76ee5f9481e80668f2649a5b43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Creating volume 2ef3ed86-b709-4572-a5c2-e1277c5b023c {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:54:46 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ef3ed86-b709-4572-a5c2-e1277c5b023c 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:46 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ef3ed86-b709-4572-a5c2-e1277c5b023c 1073741824 Jun 02 00:54:46 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Flow 'volume_create_manager' (63902c47-99ec-4f7a-8b89-a364d976f7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4e9eb1-4d73-457a-bc4e-ade530a74d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4e9eb1-4d73-457a-bc4e-ade530a74d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1913360419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8830c3-e799-44f1-a4f8-fb40e543b3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bdccfe5b00843a3923bbad65e604212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:46Z,use_quota=True,user_id='0224e76ee5f9481e80668f2649a5b43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b165ad-6690-4e43-8880-b7cadc63ab6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b165ad-6690-4e43-8880-b7cadc63ab6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db943b46-211b-46b4-aa0d-f34743804f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db943b46-211b-46b4-aa0d-f34743804f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c8830c3-e799-44f1-a4f8-fb40e543b3d7', 'volume_name': 'volume-7c8830c3-e799-44f1-a4f8-fb40e543b3d7', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3552988-f991-44e7-85e0-5cc37f20fe07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3552988-f991-44e7-85e0-5cc37f20fe07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb262f9a-e95f-4a7a-ad48-9e325a0d60b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:46 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume 7c8830c3-e799-44f1-a4f8-fb40e543b3d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c8830c3-e799-44f1-a4f8-fb40e543b3d7', 'volume_size': 1} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:46 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-f43ff6c9-c574-49b6-ba5a-9793818b1572" returned: 0 in 0.804s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-quobyte-f43ff6c9-c574-49b6-ba5a-9793818b1572" released by "delete_volume" :: held 1.784s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] Created reservations ['ce22dae2-fbf7-48db-a4c3-d4d34daed686', '44637e6e-b367-4b65-90eb-aae608c91a69', 'aeb3d56f-5256-4319-8a28-5252ff862b89', '39160182-c38d-475b-955c-f9b96e55fb96'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Flow 'volume_create_manager' (44bb8430-c9d7-492a-821d-f5c0d626cb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:46 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd27a484-23c3-4621-93cc-538d8206279e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd27a484-23c3-4621-93cc-538d8206279e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1139412945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d194792e-c316-4c76-9c20-092e4b42cf1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bdccfe5b00843a3923bbad65e604212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:47Z,use_quota=True,user_id='0224e76ee5f9481e80668f2649a5b43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ed88e9-a590-47e1-a321-5c0173e1ecb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ed88e9-a590-47e1-a321-5c0173e1ecb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0683e509-8e08-42e0-968a-8e188d6c297b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0683e509-8e08-42e0-968a-8e188d6c297b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd194792e-c316-4c76-9c20-092e4b42cf1f', 'volume_name': 'volume-d194792e-c316-4c76-9c20-092e4b42cf1f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce46a62-b497-4a63-b07c-ce4b3d93bd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce46a62-b497-4a63-b07c-ce4b3d93bd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1f614d-bda4-4470-90ab-580e0e6d0432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:47 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume d194792e-c316-4c76-9c20-092e4b42cf1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d194792e-c316-4c76-9c20-092e4b42cf1f', 'volume_size': 1} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:47 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:47 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:47 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ef3ed86-b709-4572-a5c2-e1277c5b023c 1073741824" returned: 0 in 1.172s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ef3ed86-b709-4572-a5c2-e1277c5b023c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:47 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ef3ed86-b709-4572-a5c2-e1277c5b023c Jun 02 00:54:47 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Flow 'volume_create_manager' (cdf744c1-7b0a-4b85-81f6-93b9588fdf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a912e3d-58cb-4d68-af39-215eec752cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a912e3d-58cb-4d68-af39-215eec752cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1815380631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a09d227b-4945-4203-a505-7d579e32c79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bdccfe5b00843a3923bbad65e604212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:47Z,use_quota=True,user_id='0224e76ee5f9481e80668f2649a5b43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6367835a-a116-4cfd-8011-065dbb89a5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6367835a-a116-4cfd-8011-065dbb89a5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca86c166-f48a-45c8-acf6-deed7442fcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca86c166-f48a-45c8-acf6-deed7442fcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a09d227b-4945-4203-a505-7d579e32c79f', 'volume_name': 'volume-a09d227b-4945-4203-a505-7d579e32c79f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c193af-0482-4737-98ee-e839b1e6d92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c193af-0482-4737-98ee-e839b1e6d92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec0a77c-dd1c-4a46-8e1d-3bbb5b9838b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:47 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume a09d227b-4945-4203-a505-7d579e32c79f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a09d227b-4945-4203-a505-7d579e32c79f', 'volume_size': 1} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:47 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.838s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:47 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] Deleted volume successfully. Jun 02 00:54:47 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-cf566eb5-d934-42d5-84e4-fb1bb9fb8d29 tempest-VolumeDependencyTests-1749638996 None] Lock "cinder-f43ff6c9-c574-49b6-ba5a-9793818b1572-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Flow 'volume_create_manager' (8f494547-1c14-465f-806a-3226ff27d329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87933333-f69e-4658-b718-c7e6655d7ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87933333-f69e-4658-b718-c7e6655d7ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-603871268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcae876d-d34a-429a-90aa-ceb57dac187f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bdccfe5b00843a3923bbad65e604212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:48Z,use_quota=True,user_id='0224e76ee5f9481e80668f2649a5b43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb8563a-5e47-415d-b790-79a09a61e376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb8563a-5e47-415d-b790-79a09a61e376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2486ad2-5c57-46d2-bea8-18f7ab2f47e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2486ad2-5c57-46d2-bea8-18f7ab2f47e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcae876d-d34a-429a-90aa-ceb57dac187f', 'volume_name': 'volume-dcae876d-d34a-429a-90aa-ceb57dac187f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298b1755-05c8-4476-8757-8fa12d05bddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298b1755-05c8-4476-8757-8fa12d05bddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6895a2ea-4594-447d-a61e-c0ff4ba4693a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:48 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume dcae876d-d34a-429a-90aa-ceb57dac187f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcae876d-d34a-429a-90aa-ceb57dac187f', 'volume_size': 1} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:48 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ef3ed86-b709-4572-a5c2-e1277c5b023c" returned: 0 in 1.029s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.286s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.818s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1913360419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8830c3-e799-44f1-a4f8-fb40e543b3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bdccfe5b00843a3923bbad65e604212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:46Z,use_quota=True,user_id='0224e76ee5f9481e80668f2649a5b43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Creating volume 7c8830c3-e799-44f1-a4f8-fb40e543b3d7 {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:54:48 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7c8830c3-e799-44f1-a4f8-fb40e543b3d7 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2248df47-e8e8-4edd-b487-9bcd7b0c6b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef3ed86-b709-4572-a5c2-e1277c5b023c', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:48 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7c8830c3-e799-44f1-a4f8-fb40e543b3d7 1073741824 Jun 02 00:54:48 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d380fa6-73e8-4307-8f4a-26dd03d813ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:48 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume volume-2ef3ed86-b709-4572-a5c2-e1277c5b023c (2ef3ed86-b709-4572-a5c2-e1277c5b023c): created successfully Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d380fa6-73e8-4307-8f4a-26dd03d813ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:48 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Flow 'volume_create_manager' (692d7304-0573-426c-a08f-eaf6afa8318e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:48 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-ffb99e4d-0813-4d65-a10b-d6dc45e1e363 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Created volume successfully. Jun 02 00:54:49 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7c8830c3-e799-44f1-a4f8-fb40e543b3d7 1073741824" returned: 0 in 0.990s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:49 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7c8830c3-e799-44f1-a4f8-fb40e543b3d7 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:49 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7c8830c3-e799-44f1-a4f8-fb40e543b3d7 Jun 02 00:54:49 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:50 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7c8830c3-e799-44f1-a4f8-fb40e543b3d7" returned: 0 in 0.599s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.977s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1139412945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d194792e-c316-4c76-9c20-092e4b42cf1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bdccfe5b00843a3923bbad65e604212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:47Z,use_quota=True,user_id='0224e76ee5f9481e80668f2649a5b43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Creating volume d194792e-c316-4c76-9c20-092e4b42cf1f {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:54:50 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d194792e-c316-4c76-9c20-092e4b42cf1f 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb262f9a-e95f-4a7a-ad48-9e325a0d60b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c8830c3-e799-44f1-a4f8-fb40e543b3d7', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:50 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d194792e-c316-4c76-9c20-092e4b42cf1f 1073741824 Jun 02 00:54:50 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c4048b-fd06-4f24-9090-a7c2d4825efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:50 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume volume-7c8830c3-e799-44f1-a4f8-fb40e543b3d7 (7c8830c3-e799-44f1-a4f8-fb40e543b3d7): created successfully Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c4048b-fd06-4f24-9090-a7c2d4825efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Flow 'volume_create_manager' (63902c47-99ec-4f7a-8b89-a364d976f7d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:50 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-c3e2371b-bf47-4dc4-8e69-c7204ef8b67c tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Created volume successfully. Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Flow 'volume_create_manager' (455d1336-e991-46a9-b7dd-ef9272e4b73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf61ea8-8956-4155-a240-293aa4a9f9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf61ea8-8956-4155-a240-293aa4a9f9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-52482526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6c240e-2823-46fe-8899-54ee30818cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cbef19ea5a49d2b16c82d8b87fb73a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:50Z,use_quota=True,user_id='3953f69aedee497790f2889c611604f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9934b12f-adfe-42f9-ab41-82b6ab4c7bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9934b12f-adfe-42f9-ab41-82b6ab4c7bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560f0c1d-b21a-4262-a5e8-068c1a6a48b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560f0c1d-b21a-4262-a5e8-068c1a6a48b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c6c240e-2823-46fe-8899-54ee30818cde', 'volume_name': 'volume-9c6c240e-2823-46fe-8899-54ee30818cde', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a081ba-3e1e-4465-90f0-7218ce17b9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a081ba-3e1e-4465-90f0-7218ce17b9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b230ab5a-527f-44bc-b9a8-9b36b62a022d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:50 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Volume 9c6c240e-2823-46fe-8899-54ee30818cde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c6c240e-2823-46fe-8899-54ee30818cde', 'volume_size': 1} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:50 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d194792e-c316-4c76-9c20-092e4b42cf1f 1073741824" returned: 0 in 0.771s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:50 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d194792e-c316-4c76-9c20-092e4b42cf1f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:50 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d194792e-c316-4c76-9c20-092e4b42cf1f Jun 02 00:54:50 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:51 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d194792e-c316-4c76-9c20-092e4b42cf1f" returned: 0 in 0.559s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:54:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.662s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1815380631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a09d227b-4945-4203-a505-7d579e32c79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bdccfe5b00843a3923bbad65e604212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:47Z,use_quota=True,user_id='0224e76ee5f9481e80668f2649a5b43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:54:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Creating volume a09d227b-4945-4203-a505-7d579e32c79f {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:54:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:51 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:54:51 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:54:51 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a09d227b-4945-4203-a505-7d579e32c79f 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1f614d-bda4-4470-90ab-580e0e6d0432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d194792e-c316-4c76-9c20-092e4b42cf1f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:51 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a09d227b-4945-4203-a505-7d579e32c79f 1073741824 Jun 02 00:54:51 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1fa338-3f2e-446c-b73f-872c1795ded8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:51 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume volume-d194792e-c316-4c76-9c20-092e4b42cf1f (d194792e-c316-4c76-9c20-092e4b42cf1f): created successfully Jun 02 00:54:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1fa338-3f2e-446c-b73f-872c1795ded8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:51 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Flow 'volume_create_manager' (44bb8430-c9d7-492a-821d-f5c0d626cb6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:51 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-3ea6cbcb-ccf5-43cf-84a5-ef8185227d52 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Created volume successfully. Jun 02 00:54:52 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a09d227b-4945-4203-a505-7d579e32c79f 1073741824" returned: 0 in 0.734s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a09d227b-4945-4203-a505-7d579e32c79f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:52 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a09d227b-4945-4203-a505-7d579e32c79f Jun 02 00:54:52 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:52 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a09d227b-4945-4203-a505-7d579e32c79f" returned: 0 in 0.580s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.468s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-603871268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcae876d-d34a-429a-90aa-ceb57dac187f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bdccfe5b00843a3923bbad65e604212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:48Z,use_quota=True,user_id='0224e76ee5f9481e80668f2649a5b43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Creating volume dcae876d-d34a-429a-90aa-ceb57dac187f {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:54:52 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-dcae876d-d34a-429a-90aa-ceb57dac187f 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:52 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-dcae876d-d34a-429a-90aa-ceb57dac187f 1073741824 Jun 02 00:54:52 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec0a77c-dd1c-4a46-8e1d-3bbb5b9838b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a09d227b-4945-4203-a505-7d579e32c79f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7115e90a-138a-4c58-b766-6bad5b240129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:52 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume volume-a09d227b-4945-4203-a505-7d579e32c79f (a09d227b-4945-4203-a505-7d579e32c79f): created successfully Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7115e90a-138a-4c58-b766-6bad5b240129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:52 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Flow 'volume_create_manager' (cdf744c1-7b0a-4b85-81f6-93b9588fdf2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:52 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e968df0b-6be3-4f2a-a636-a6ea961ed9c0 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Created volume successfully. Jun 02 00:54:53 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-dcae876d-d34a-429a-90aa-ceb57dac187f 1073741824" returned: 0 in 0.736s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:53 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-dcae876d-d34a-429a-90aa-ceb57dac187f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:53 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-dcae876d-d34a-429a-90aa-ceb57dac187f Jun 02 00:54:53 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:54 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-dcae876d-d34a-429a-90aa-ceb57dac187f" returned: 0 in 0.600s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.793s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-52482526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6c240e-2823-46fe-8899-54ee30818cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cbef19ea5a49d2b16c82d8b87fb73a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:54:50Z,use_quota=True,user_id='3953f69aedee497790f2889c611604f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)}" {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Creating volume 9c6c240e-2823-46fe-8899-54ee30818cde {{(pid=86910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:54:54 devstack cinder-volume[86910]: INFO cinder.volume.drivers.remotefs [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] casted to osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde 1073741824 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6895a2ea-4594-447d-a61e-c0ff4ba4693a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcae876d-d34a-429a-90aa-ceb57dac187f', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:54 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde 1073741824 Jun 02 00:54:54 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d942eae-7c99-4611-86b7-e9744c376414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:54 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Volume volume-dcae876d-d34a-429a-90aa-ceb57dac187f (dcae876d-d34a-429a-90aa-ceb57dac187f): created successfully Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d942eae-7c99-4611-86b7-e9744c376414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Flow 'volume_create_manager' (8f494547-1c14-465f-806a-3226ff27d329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:54 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-080074de-e707-436b-b30d-3c83d3e458ec tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Created volume successfully. Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "cinder-dcae876d-d34a-429a-90aa-ceb57dac187f-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-dcae876d-d34a-429a-90aa-ceb57dac187f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "cinder-quobyte-dcae876d-d34a-429a-90aa-ceb57dac187f" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-quobyte-dcae876d-d34a-429a-90aa-ceb57dac187f" acquired by "delete_volume" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde2347c-0552-44f4-97c9-91825b453791]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-dcae876d-d34a-429a-90aa-ceb57dac187f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:54 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:54 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde 1073741824" returned: 0 in 0.807s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:55 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-dcae876d-d34a-429a-90aa-ceb57dac187f Jun 02 00:54:55 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:55 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde Jun 02 00:54:55 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:55 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde" returned: 0 in 0.587s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:55 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'} {{(pid=86910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 02 00:54:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:55 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-dcae876d-d34a-429a-90aa-ceb57dac187f" returned: 0 in 0.705s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:55 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-dcae876d-d34a-429a-90aa-ceb57dac187f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b230ab5a-527f-44bc-b9a8-9b36b62a022d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c6c240e-2823-46fe-8899-54ee30818cde', 'volume_size': 1}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0e699b-09ac-4649-8117-3084d3e56c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:54:55 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-dcae876d-d34a-429a-90aa-ceb57dac187f Jun 02 00:54:55 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:55 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Volume volume-9c6c240e-2823-46fe-8899-54ee30818cde (9c6c240e-2823-46fe-8899-54ee30818cde): created successfully Jun 02 00:54:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0e699b-09ac-4649-8117-3084d3e56c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:54:55 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Flow 'volume_create_manager' (455d1336-e991-46a9-b7dd-ef9272e4b73e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:54:55 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-5dea29da-6022-45a9-9941-8ea42881c878 tempest-SnapshotDependencyTests-84270765 None] Created volume successfully. Jun 02 00:54:56 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-dcae876d-d34a-429a-90aa-ceb57dac187f" returned: 0 in 0.576s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-quobyte-dcae876d-d34a-429a-90aa-ceb57dac187f" released by "delete_volume" :: held 1.327s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:56 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Created reservations ['69f073e5-47a8-4e14-b36f-120699607815', 'f37cd26c-61b1-4fe4-87f7-fd4ef0dd634d', 'e8e82d0c-1cfe-4115-a98b-daf48224b99d', '7195f3e1-cf9a-4363-bdcb-0a3ccd98e992'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:56 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:56 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:56 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] Creating offline snapshot fa203303-154a-4bdb-8c5f-1b592b839e71 of volume 9c6c240e-2823-46fe-8899-54ee30818cde {{(pid=86910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 00:54:56 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bb26c7-6ced-4669-963f-5fb8c04b0a7e]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:56 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:56 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.605s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:56 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:56 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Deleted volume successfully. Jun 02 00:54:56 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-83d8decc-53f2-4015-b7fc-11fc36d5c4c1 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-dcae876d-d34a-429a-90aa-ceb57dac187f-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:56 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde Jun 02 00:54:56 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "cinder-a09d227b-4945-4203-a505-7d579e32c79f-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-a09d227b-4945-4203-a505-7d579e32c79f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "cinder-quobyte-a09d227b-4945-4203-a505-7d579e32c79f" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:57 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-quobyte-a09d227b-4945-4203-a505-7d579e32c79f" acquired by "delete_volume" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:57 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ec3291-9534-4b9a-90cc-efed629397a7]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a09d227b-4945-4203-a505-7d579e32c79f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:57 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a09d227b-4945-4203-a505-7d579e32c79f Jun 02 00:54:57 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:57 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde" returned: 0 in 0.721s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71 1G {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:57 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71 1G Jun 02 00:54:57 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:57 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a09d227b-4945-4203-a505-7d579e32c79f" returned: 0 in 0.721s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:57 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a09d227b-4945-4203-a505-7d579e32c79f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:57 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a09d227b-4945-4203-a505-7d579e32c79f Jun 02 00:54:57 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:58 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71 1G" returned: 0 in 0.770s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c6c240e-2823-46fe-8899-54ee30818cde -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-a09d227b-4945-4203-a505-7d579e32c79f" returned: 0 in 0.603s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:58 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-quobyte-a09d227b-4945-4203-a505-7d579e32c79f" released by "delete_volume" :: held 1.366s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:58 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c6c240e-2823-46fe-8899-54ee30818cde -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71 Jun 02 00:54:58 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:58 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:58 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Created reservations ['34cf316e-690d-4002-a37c-3160077ff6a2', '98dfdb33-66cf-4596-b920-845728e82947', '9dcdd70f-b5a4-429a-a6bb-30a393913c04', 'b68775ab-3d6c-4fda-b0c7-b4f42d059587'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:54:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:54:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:54:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:54:58 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:54:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:54:58 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:58 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:54:58 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:59 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c6c240e-2823-46fe-8899-54ee30818cde -F qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71" returned: 0 in 0.675s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:59 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71 is being set with open permissions: ugo+rw Jun 02 00:54:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:59 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71 Jun 02 00:54:59 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:59 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.615s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:59 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:54:59 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Deleted volume successfully. Jun 02 00:54:59 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-73c208b2-5abf-4a8e-a094-ff839aac2ab2 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-a09d227b-4945-4203-a505-7d579e32c79f-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:54:59 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "cinder-d194792e-c316-4c76-9c20-092e4b42cf1f-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:59 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-d194792e-c316-4c76-9c20-092e4b42cf1f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:59 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "cinder-quobyte-d194792e-c316-4c76-9c20-092e4b42cf1f" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:54:59 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-quobyte-d194792e-c316-4c76-9c20-092e4b42cf1f" acquired by "delete_volume" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:54:59 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1969365c-af48-4c37-aaf6-1aa3c1ea3f2c]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:54:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d194792e-c316-4c76-9c20-092e4b42cf1f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:59 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d194792e-c316-4c76-9c20-092e4b42cf1f Jun 02 00:54:59 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:54:59 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jun 02 00:54:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71" returned: 0 in 0.596s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:54:59 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:54:59 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.info Jun 02 00:54:59 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:00 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d194792e-c316-4c76-9c20-092e4b42cf1f" returned: 0 in 0.755s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d194792e-c316-4c76-9c20-092e4b42cf1f {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:00 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d194792e-c316-4c76-9c20-092e4b42cf1f Jun 02 00:55:00 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:00 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.info" returned: 0 in 0.599s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:00 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.info is being set with open permissions: ugo+rw Jun 02 00:55:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.info {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:00 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.info Jun 02 00:55:00 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:00 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-d194792e-c316-4c76-9c20-092e4b42cf1f" returned: 0 in 0.603s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:00 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-quobyte-d194792e-c316-4c76-9c20-092e4b42cf1f" released by "delete_volume" :: held 1.396s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:55:00 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Created reservations ['cd582627-ff48-46c5-9a1d-cfabac27f4f8', 'd62a37e3-83cc-493a-a81c-c784ad1f14bc', '2ca409af-c6c0-4f8a-baeb-1730bfc78327', '67778da6-6da7-431e-a10a-7ba2098289bd'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:55:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:55:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:55:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:55:00 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:55:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:55:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:00 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.info" returned: 0 in 0.605s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:00 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:55:00 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.055s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:55:00 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:00 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-dccfb761-bb81-4660-b098-53caf13d012e tempest-SnapshotDependencyTests-84270765 None] Create snapshot completed successfully Jun 02 00:55:01 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.598s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:55:01 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Deleted volume successfully. Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-01b1ba7b-c712-479c-9e9d-91a76dedd27b tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-d194792e-c316-4c76-9c20-092e4b42cf1f-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "cinder-7c8830c3-e799-44f1-a4f8-fb40e543b3d7-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-7c8830c3-e799-44f1-a4f8-fb40e543b3d7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "cinder-quobyte-7c8830c3-e799-44f1-a4f8-fb40e543b3d7" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-quobyte-7c8830c3-e799-44f1-a4f8-fb40e543b3d7" acquired by "delete_volume" :: waited 0.019s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Flow 'volume_create_manager' (12fbbf1d-5588-4d18-8ec1-d3da8e866fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ec8126-313a-4aae-97ee-0b5f1aff1be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[4002df29-4728-4475-8c22-7e43828977ce]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7c8830c3-e799-44f1-a4f8-fb40e543b3d7 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ec8126-313a-4aae-97ee-0b5f1aff1be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-01T22:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a90110-b7df-4342-87d8-d32eb71050ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cbef19ea5a49d2b16c82d8b87fb73a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T22:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fa203303-154a-4bdb-8c5f-1b592b839e71,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T22:55:02Z,use_quota=True,user_id='3953f69aedee497790f2889c611604f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0822d3b7-db40-4e50-9044-e3eef612a802),volume_type_id=0822d3b7-db40-4e50-9044-e3eef612a802)' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f4acd4-9923-4b93-b360-2d33c3c210a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f4acd4-9923-4b93-b360-2d33c3c210a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ae6d88-9205-4db4-be66-43192ba2d213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ae6d88-9205-4db4-be66-43192ba2d213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '25a90110-b7df-4342-87d8-d32eb71050ce', 'volume_name': 'volume-25a90110-b7df-4342-87d8-d32eb71050ce', 'volume_size': 1, 'snapshot_id': 'fa203303-154a-4bdb-8c5f-1b592b839e71'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2d35f9-2dd1-441c-9afe-63825629ba45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2d35f9-2dd1-441c-9afe-63825629ba45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9d3892-e128-4ba1-b3ee-65720976979c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:55:01 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Volume 25a90110-b7df-4342-87d8-d32eb71050ce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-25a90110-b7df-4342-87d8-d32eb71050ce', 'volume_size': 1, 'snapshot_id': 'fa203303-154a-4bdb-8c5f-1b592b839e71'} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Acquiring lock "cinder-quobyte-fa203303-154a-4bdb-8c5f-1b592b839e71-25a90110-b7df-4342-87d8-d32eb71050ce" by "_create_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-quobyte-fa203303-154a-4bdb-8c5f-1b592b839e71-25a90110-b7df-4342-87d8-d32eb71050ce" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Creating volume 25a90110-b7df-4342-87d8-d32eb71050ce from snapshot fa203303-154a-4bdb-8c5f-1b592b839e71 {{(pid=86910) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Selected osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736 as target Quobyte volume. {{(pid=86910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Acquiring lock "cinder-quobyte-25a90110-b7df-4342-87d8-d32eb71050ce" by "_copy_volume_from_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-quobyte-25a90110-b7df-4342-87d8-d32eb71050ce" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] snapshot: fa203303-154a-4bdb-8c5f-1b592b839e71, volume: 25a90110-b7df-4342-87d8-d32eb71050ce, {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 00:55:01 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7c8830c3-e799-44f1-a4f8-fb40e543b3d7 Jun 02 00:55:01 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc0044f-35c5-4dbe-90f1-7657831e9fd2]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:55:01 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:01 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71 Jun 02 00:55:01 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:02 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7c8830c3-e799-44f1-a4f8-fb40e543b3d7" returned: 0 in 0.705s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7c8830c3-e799-44f1-a4f8-fb40e543b3d7 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:02 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7c8830c3-e799-44f1-a4f8-fb40e543b3d7 Jun 02 00:55:02 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:02 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71" returned: 0 in 0.736s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:02 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c6c240e-2823-46fe-8899-54ee30818cde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:55:02 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 00:55:02 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Creating direct copy from snapshot {{(pid=86910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 00:55:02 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[440fc7cc-a9e5-4586-b2bd-eaccec48589f]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:55:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:02 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde Jun 02 00:55:02 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:02 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:02 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-7c8830c3-e799-44f1-a4f8-fb40e543b3d7" returned: 0 in 0.583s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:02 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-quobyte-7c8830c3-e799-44f1-a4f8-fb40e543b3d7" released by "delete_volume" :: held 1.341s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Created reservations ['c35832d1-d78f-4f51-bdbe-feb15d9de93b', 'd6223423-03a5-4763-8cb2-157f40e82998', 'fe99c7b3-b4de-44b0-920e-1ca8a891a32f', 'b15cd560-024c-4472-8973-ee5685c59941'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:03 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:55:03 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:03 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde" returned: 0 in 0.747s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG cinder.utils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Path /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-25a90110-b7df-4342-87d8-d32eb71050ce not found in is_blk_device check {{(pid=86910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-25a90110-b7df-4342-87d8-d32eb71050ce {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:03 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-25a90110-b7df-4342-87d8-d32eb71050ce Jun 02 00:55:03 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:03 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.608s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:55:03 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Deleted volume successfully. Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-b234369a-8f12-427f-9757-62e1462d1316 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-7c8830c3-e799-44f1-a4f8-fb40e543b3d7-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "cinder-2ef3ed86-b709-4572-a5c2-e1277c5b023c-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-2ef3ed86-b709-4572-a5c2-e1277c5b023c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "cinder-quobyte-2ef3ed86-b709-4572-a5c2-e1277c5b023c" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-quobyte-2ef3ed86-b709-4572-a5c2-e1277c5b023c" acquired by "delete_volume" :: waited 0.020s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[715a78fe-6a52-4c42-a9bb-188257aa8fb7]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:55:03 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ef3ed86-b709-4572-a5c2-e1277c5b023c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:03 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ef3ed86-b709-4572-a5c2-e1277c5b023c Jun 02 00:55:03 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:04 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ef3ed86-b709-4572-a5c2-e1277c5b023c" returned: 0 in 1.060s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:04 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ef3ed86-b709-4572-a5c2-e1277c5b023c {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:04 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ef3ed86-b709-4572-a5c2-e1277c5b023c Jun 02 00:55:04 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:06 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-2ef3ed86-b709-4572-a5c2-e1277c5b023c" returned: 0 in 1.188s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:06 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-quobyte-2ef3ed86-b709-4572-a5c2-e1277c5b023c" released by "delete_volume" :: held 2.304s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:55:06 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Created reservations ['e12e92ab-0d15-4ba9-9359-1475a330bf58', 'fbeb71ee-8dd2-4317-b2f9-126a503af55d', 'b45df098-799f-4bf7-bd78-539c7c35c3e0', 'f71e2bd8-1947-4712-b9de-72d74643c24a'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:55:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:55:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:55:06 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:55:06 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:55:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:55:06 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:06 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:55:06 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "cinder-8c70d97f-d31e-489b-943f-1cee2c8cbaad-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:55:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-8c70d97f-d31e-489b-943f-1cee2c8cbaad-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:55:07 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.977s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:07 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:55:07 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Deleted volume successfully. Jun 02 00:55:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-e34d0d46-f620-4ef5-8efc-4337e4a8a52e tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-2ef3ed86-b709-4572-a5c2-e1277c5b023c-delete_volume" released by "delete_volume" :: held 3.668s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:55:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "cinder-quobyte-8c70d97f-d31e-489b-943f-1cee2c8cbaad" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:55:07 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-quobyte-8c70d97f-d31e-489b-943f-1cee2c8cbaad" acquired by "delete_volume" :: waited 0.026s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:55:07 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2410f10-180d-45b4-894a-de58c2bb1a62]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:55:07 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8c70d97f-d31e-489b-943f-1cee2c8cbaad {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:07 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8c70d97f-d31e-489b-943f-1cee2c8cbaad Jun 02 00:55:07 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:08 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-25a90110-b7df-4342-87d8-d32eb71050ce" returned: 0 in 5.120s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:08 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[300a327d-a0ec-491b-932b-9ba12a43f7d0]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:55:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:08 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde Jun 02 00:55:08 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:08 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8c70d97f-d31e-489b-943f-1cee2c8cbaad" returned: 0 in 1.064s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:08 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8c70d97f-d31e-489b-943f-1cee2c8cbaad {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:08 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8c70d97f-d31e-489b-943f-1cee2c8cbaad Jun 02 00:55:08 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:09 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-8c70d97f-d31e-489b-943f-1cee2c8cbaad" returned: 0 in 0.589s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:09 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-quobyte-8c70d97f-d31e-489b-943f-1cee2c8cbaad" released by "delete_volume" :: held 1.734s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:55:09 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Created reservations ['b7616ac8-f8c0-43e0-88aa-7aa22d9d14aa', 'f73d1b60-e31a-4884-bd74-7a045d608e21', 'e5c782a6-3017-4a0c-a27e-617d7b81bde1', 'ca56b564-771a-4ef9-8358-163ef8e31dd3'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:55:09 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde" returned: 0 in 0.919s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:09 devstack cinder-volume[86910]: DEBUG cinder.image.image_utils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Image conversion details: src /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde, size 1024.00 MB, duration 5.12 sec, destination /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-25a90110-b7df-4342-87d8-d32eb71050ce {{(pid=86910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 02 00:55:09 devstack cinder-volume[86910]: INFO cinder.image.image_utils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Converted 1024.00 MB image at 199.93 MB/s Jun 02 00:55:09 devstack cinder-volume[86910]: WARNING cinder.volume.drivers.remotefs [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-25a90110-b7df-4342-87d8-d32eb71050ce is being set with open permissions: ugo+rw Jun 02 00:55:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-25a90110-b7df-4342-87d8-d32eb71050ce {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:55:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:55:09 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:55:09 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:55:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:55:09 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:09 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-25a90110-b7df-4342-87d8-d32eb71050ce Jun 02 00:55:09 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:09 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:55:09 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:10 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-25a90110-b7df-4342-87d8-d32eb71050ce" returned: 0 in 0.649s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:10 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-quobyte-25a90110-b7df-4342-87d8-d32eb71050ce" released by "_copy_volume_from_snapshot" :: held 8.279s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.633s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-quobyte-fa203303-154a-4bdb-8c5f-1b592b839e71-25a90110-b7df-4342-87d8-d32eb71050ce" released by "_create_volume_from_snapshot" :: held 8.310s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.326s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:55:10 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Deleted volume successfully. Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-d9ba3141-95e6-40b1-b97e-af5e68fbd595 tempest-CreateVolumesFromSourceVolumeTest-1747061657 None] Lock "cinder-8c70d97f-d31e-489b-943f-1cee2c8cbaad-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9d3892-e128-4ba1-b3ee-65720976979c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a90110-b7df-4342-87d8-d32eb71050ce', 'volume_size': 1, 'snapshot_id': 'fa203303-154a-4bdb-8c5f-1b592b839e71'}' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6da505-0827-4092-9919-fe93c386f5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 00:55:10 devstack cinder-volume[86910]: INFO cinder.volume.flows.manager.create_volume [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Volume volume-25a90110-b7df-4342-87d8-d32eb71050ce (25a90110-b7df-4342-87d8-d32eb71050ce): created successfully Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6da505-0827-4092-9919-fe93c386f5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86910) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG cinder.volume.manager [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Flow 'volume_create_manager' (12fbbf1d-5588-4d18-8ec1-d3da8e866fef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86910) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 00:55:10 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-fc3fe8b5-670c-477f-a30a-9e23b4c8a100 tempest-SnapshotDependencyTests-84270765 None] Created volume successfully. Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] Acquiring lock "cinder-fa203303-154a-4bdb-8c5f-1b592b839e71-delete_snapshot" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-fa203303-154a-4bdb-8c5f-1b592b839e71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] Acquiring lock "cinder-quobyte-9c6c240e-2823-46fe-8899-54ee30818cde" by "delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-quobyte-9c6c240e-2823-46fe-8899-54ee30818cde" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] Acquiring lock "cinder-quobyte-fa203303-154a-4bdb-8c5f-1b592b839e71" by "_delete_snapshot" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-quobyte-fa203303-154a-4bdb-8c5f-1b592b839e71" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] Deleting offline snapshot fa203303-154a-4bdb-8c5f-1b592b839e71 of volume 9c6c240e-2823-46fe-8899-54ee30818cde {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] snapshot_file for this snap is: volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71 {{(pid=86910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b47bf8b-bc34-45d6-a09a-feaf8d67e71f]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:55:10 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:10 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71 Jun 02 00:55:10 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:11 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71" returned: 0 in 0.770s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:11 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.remotefs [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c6c240e-2823-46fe-8899-54ee30818cde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 00:55:11 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10b3a09-6b11-49bd-b710-180f066cdf53]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:55:11 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:11 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde Jun 02 00:55:11 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:12 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde" returned: 0 in 0.713s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:12 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71 Jun 02 00:55:12 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:12 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71" returned: 0 in 0.655s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:12 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71 {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:12 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71 Jun 02 00:55:12 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:13 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde.fa203303-154a-4bdb-8c5f-1b592b839e71" returned: 0 in 0.590s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:13 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-quobyte-fa203303-154a-4bdb-8c5f-1b592b839e71" released by "_delete_snapshot" :: held 2.839s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:55:13 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-quobyte-9c6c240e-2823-46fe-8899-54ee30818cde" released by "delete_snapshot" :: held 2.863s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:55:13 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] Created reservations ['e27b9c5a-1336-4a6e-a641-626bdb5f242d', '24fc5657-5e26-4228-a05c-63d164178231', '5f929c87-a3d2-441b-bbb5-ec45dae0ac98', 'c827c2de-13f8-4497-9e03-6eeeb1643ae7'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:55:13 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] Delete snapshot completed successfully. Jun 02 00:55:13 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-6e2619d2-b2c4-4e24-a2c0-34c5b832b267 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-fa203303-154a-4bdb-8c5f-1b592b839e71-delete_snapshot" released by "delete_snapshot" :: held 2.991s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:55:13 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] Acquiring lock "cinder-9c6c240e-2823-46fe-8899-54ee30818cde-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:55:13 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-9c6c240e-2823-46fe-8899-54ee30818cde-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:55:13 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] Acquiring lock "cinder-quobyte-9c6c240e-2823-46fe-8899-54ee30818cde" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:55:13 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-quobyte-9c6c240e-2823-46fe-8899-54ee30818cde" acquired by "delete_volume" :: waited 0.015s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:55:13 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c8b4ea-1df2-49d5-b139-ac118c3e67ca]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:55:13 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:13 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde Jun 02 00:55:13 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:14 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde" returned: 0 in 0.693s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:14 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:14 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde Jun 02 00:55:14 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:14 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-9c6c240e-2823-46fe-8899-54ee30818cde" returned: 0 in 0.582s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-quobyte-9c6c240e-2823-46fe-8899-54ee30818cde" released by "delete_volume" :: held 1.330s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] Created reservations ['e8f08b2c-7b68-4cf2-a0d6-f15cf1e1abb2', '8940c0ee-9a79-43e1-96c0-0f7d2fdbe3a7', 'a5ba90da-0af6-4c70-9c6e-8fde94351226', '789641ff-c9a8-40ea-9f29-c03004ca0d59'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:15 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:55:15 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG oslo_service.periodic_task [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86910) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:15 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:55:15 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:15 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.580s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:55:15 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] Deleted volume successfully. Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-336e2487-25ff-4be9-a8b6-98bc7d11a870 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-9c6c240e-2823-46fe-8899-54ee30818cde-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] Acquiring lock "cinder-25a90110-b7df-4342-87d8-d32eb71050ce-delete_volume" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-25a90110-b7df-4342-87d8-d32eb71050ce-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:55:15 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.609s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-5446ff8a-98d3-47fd-9e58-a2ece291c002 None None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] Acquiring lock "cinder-quobyte-25a90110-b7df-4342-87d8-d32eb71050ce" by "delete_volume" {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-quobyte-25a90110-b7df-4342-87d8-d32eb71050ce" acquired by "delete_volume" :: waited 0.020s {{(pid=86910) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5a6e47-27aa-40a0-88ed-c75500e83e09]: (4, 'qcow2') {{(pid=87934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 00:55:15 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-25a90110-b7df-4342-87d8-d32eb71050ce {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:16 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-25a90110-b7df-4342-87d8-d32eb71050ce Jun 02 00:55:16 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:16 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-25a90110-b7df-4342-87d8-d32eb71050ce" returned: 0 in 0.676s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:16 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-25a90110-b7df-4342-87d8-d32eb71050ce {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:16 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-25a90110-b7df-4342-87d8-d32eb71050ce Jun 02 00:55:16 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:17 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e/volume-25a90110-b7df-4342-87d8-d32eb71050ce" returned: 0 in 0.593s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:17 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-quobyte-25a90110-b7df-4342-87d8-d32eb71050ce" released by "delete_volume" :: held 1.307s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:55:17 devstack cinder-volume[86910]: DEBUG cinder.quota [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] Created reservations ['4408ad6b-43e4-4690-9f37-96fc840a3798', '2fa81bc8-5cef-4fbe-af4c-072770047184', '92b0db31-744d-4f6e-9469-53f014bb53d3', '5fbe3835-aabf-4b76-ad25-0a20a46943ad'] {{(pid=86910) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 00:55:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 00:55:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 00:55:17 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736': None} {{(pid=86910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 00:55:17 devstack cinder-volume[86910]: DEBUG cinder.volume.drivers.quobyte [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-389ce4f3-038e-4e86-af79-31aa07e74736'] {{(pid=86910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 00:55:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.lockutils [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 00:55:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 00:55:17 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e Jun 02 00:55:17 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 00:55:17 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jun 02 00:55:17 devstack cinder-volume[86910]: DEBUG oslo_concurrency.processutils [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5dca6cba70bfb9fa6b8136dcfbf4437e" returned: 0 in 0.584s {{(pid=86910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 00:55:17 devstack cinder-volume[86910]: DEBUG cinder.manager [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] Notifying Schedulers of capabilities ... {{(pid=86910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 02 00:55:17 devstack cinder-volume[86910]: INFO cinder.volume.manager [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] Deleted volume successfully. Jun 02 00:55:17 devstack cinder-volume[86910]: DEBUG cinder.coordination [None req-606ef754-5f9f-42ab-b15f-a9b05d7cefe4 tempest-SnapshotDependencyTests-84270765 None] Lock "cinder-25a90110-b7df-4342-87d8-d32eb71050ce-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=86910) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 00:55:27 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=80,cinder:UPDATE=102,cinder:INSERT=27,cinder:DELETE=8 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 00:55:27 devstack cinder-volume[86910]: DEBUG dbcounter [-] [86910] Writing DB stats cinder:SELECT=75,cinder:INSERT=27,cinder:UPDATE=124,cinder:DELETE=11 {{(pid=86910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}